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Constitutional Mandate 

Pursuant to Article VII, Section 10 of the Hawaii State Constitution, the 
Office of the Auditor shall conduct post-audits of the transactions, accounts, 
programs and performance of all departments, offices and agencies of the 
State and its political subdivisions. ^ 

The Auditor’s position was established to help eliminate waste and A'' 
inefficiency in government, provide the Legislature with a check agau^the 
powers of the executive branch, and ensure that public funds arqs^i^nded 
according to legislative intent. 

Hawaii Revised Statutes, Chapter 23, gives the Auditor bf^fe^Kpowers to 
examine all books, records, files, papers and documentsT^d financial 
affairs of every agency. The Auditor also has the aute^y to summon 
people to produce records and answer questions iidjM oath. 


Our Mission V 

To improve government through indeoefSent and objective anaiyses. 

We provide independent, objectn^^^nd meaningful answers to questions 
about government performanqeS^ur aim is to hold agencies accountable 
for their policy implemental|KJlvprogram management and expenditure of 
public funds. ^ 



Our Work 


We conductv^formance audits (also called management or operations 
audits), wl(^^xamine the efficiency and effectiveness of government 
prograwtjr agencies, as well as financial audits, which attest to the 
fairn^^/of financial statements of the State and its agencies. 

>ggitionallv. we perform procurement audits, sunrise analyses and sunset 
Waluations of proposed regulatory programs, analyses of proposals to 
mandate health insurance benefits, analyses of proposed special and 
revolving funds, analyses of existing special, revolving and trust funds, and 
special studies requested by the Legislature. 

We report our findings and make recommendations to the Governor and the 
Legislature to help them make informed decisions. 


For more information on the Office of the Auditor, visit our website: 
http://auditor.hawaii.qov 




Foreword 




Our audit of the Honolulu Authority for Rapid Transportation 
was conducted pursuant to Act 1, which the Hawai‘i State LegjljHnire 
passed during the 2017 First Special Session. Act 1 requk^^e Auditor 
to conduct an audit of the financial records and an analysiQof the 
financial management of HART. This audit report f^ti^s on HART’s 
management structure, decision-making processegri^^ use of third- 
party consultants in key management positiop^^ 

This audit was somewhat unique for us in<^ HART is a quasi¬ 
independent agency of the City and of Honolulu and not an 

agency of the State of HawaiT. Hc^^er, the State Constitution, 

Article VII, Section 10, empoyr^^^e Auditor to conduct audits of 
all departments, offices, and'^cdnies of the State and its political 
subdivisions. 

During the course audit work, we gained information about 

HART from the O^^e of the City Auditor (City Auditor), City and 
County of Hm<^1u. The City Auditor previously audited HART and 
is conductj^^nother audit of HART concurrent with our audit. We 
apprec(^ me City Auditor’s generous support of our work. 




s 




<r 






express our thanks to HART and members of its Board of 
Directors whom we contacted during the course of our audit for their 
Assistance. 


Leslie H. Kondo 
State Auditor 
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ING THE 2017 First Special Session, the Hawai‘i State 
Legislature passed Senate Bill No. 4, which was signed by 
the Governor as Act 1. Act 1 provided additional sources 
_ of funding for the Flonolulu Rail Transit Project (Project), 

extending the surcharge on the Hawai‘i general excise tax (GET) and 


increasing the Transient Accommodations Tax (TAT). Act 1 also called 
for an audit by the State Auditor of the Flonolulu Authority for Rapid 
Transportation (HART). The audit dictated under Act 1 includes, among 
other things, an “analysis of the financial management” of HART to 
determine whether funds received by HART from the County surcharge 
on State tax “are being managed and used in a reasonable manner.” 

This report examines some of these issues. 


The audit dictated 
under Act 1 includes, 
among other things, 
an “analysis of the 
financial management” 
of HART to determine 
whether funds received 
by HART from the 
County surcharge on 
State tax “are being 
managed and used in a 
reasonable manner.” 


The Buck Stops...Wtere? 

Report on MART’S l^ranagement 
Structure, DecisiG^-Making 
Processes, and^se of Third-Party 
Consultantsdt^ey Management 
Positions 

.-V/ 
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To assess HART’s use of the State revenues, it is essential to understand 
hart’s management and decision-making structure as a foundation 
for this and other reports to come. This report is intended to describe 
and explain this foundation. We report HART’s current management r 
structure, the relationship between HART and its Board of Directors 
(Board), and HART’s use of third-party consultants - notably, the ^ 

project management support consultant, HDR Engineering, Inc. (I 
- to manage the Project. 

Our review and analysis of HART’s management structur^h^t^ealed 
some concerns that we also detail in this report. First.,yiQvfound that 
HART’s decision-making processes, in particular fraction and 
division of responsibilities between HART’s Ch^Executive Officer 
(CEO) and the Board, have changed over tir 
After several years of operation, billions o^ 

numerous delays, and substantial cost i^j^J^ses, these responsibilities - 
and the corresponding accountabili1(5^wiould have been clearly defined 
well-before now. Instead, it took^^tn 6 amendment to the Revised 
Charter of the City and Counfij^)®onolulu to spur proposed changes, 
which were still under consifl^tion at the time of our audit. 

Second, we found that HART uses third-party consultants rather than 
HART employees^I^Siiany key management positions. While this 
may be a conceg^n to certain operational realities, we also found that 
HART’s ov^^ht of these consultants given their critical roles on the 
Project i^^sv^erficial, not well-documented, and does not adequately 
ensur^m^formance and accountability to HART and the City and 
Cqunty of Honolulu (City). For example, consultants often manage 
ultants who manage other consultants, with little, if any, oversight 
•^ihy HART staff or management. HART also does not evaluate the 
performance of its consultants and has not been keeping complete 


records of its audits of consultants’ quality assurance work. At a 
minimum, this limits accountability, undermining confidence in the 
process and hurting quality controls. 

This is the second of four reports relating to HART that we plan to issue 
pursuant to Act 1. The first report presented the background and issues 
relating to, among other things, the estimated project costs, construction 
schedules, and completion dates from 2014 through 2016; other reports 
will present the process HART and the Department of Accounting and 
General Services have implemented related to the payment of “capital 
costs” from the Mass Transit Special Fund; and HART’s invoice 
payment process for selected construction and consultant invoices. 
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Audit Objectives 


1. Describe the current condition of HART’s administration and 
operations. 

2. Assess whether HART’s oversight and management of selected 
consultants is in compliance with applicable laws, policies, 
procedures, and other relevant best practices. 

3. Make recommendations as appropriate. 


Audit Scope and Methodology 


This audit was performed pursuant to Act 1, First Special Session 2017, 
which directs the State Auditor to conduct an audit of HART. Act 1 
requires the audit to include an examination of the financial records 
an analysis of the financial management of HART. This is our fii|gj2wait 
of HART.' .X 

The part of our audit reported herein focused on fiscal ve^ajl^Ol? 
and 2018; however, we also reviewed HART activitv^q^mocuments 
outside of that period, where relevant. We conductemkiterviews with 
the HART CEO and other managers, HART sta^ft^e Board Chair, and 
certain HART consultants. We reviewed appjp^le laws, policies and 
procedures, board minutes, and other do^^^ntation. Additionally, we 
judgmentally selected consultant conto^based on their relevance to 
project oversight. We examined coj^^Jltant contracts, the consultants’ 
applicable policies and procedures, reports submitted to HART by the 
consultants, and other relevqt^^wuments to assess HART’s oversight of 
the consultants. 




Difficulties wit^^^ess to information 

Pursuant to 7, Section 7.11 of Government Auditing Standards 

issued by the Oifited States Government Accountability Office, 
“Reporjjii^^ndards for Performance Audits,” auditors should report 
‘inform^on limitations . . . including denials or excessive delays of 
asx^Sto certain records or individuals.” 



lART management and the Board expressly pledged HART’s full and 
complete cooperation with our audit. However, that promise was not 
kept, as we encountered numerous difficulties in obtaining cooperation 
and information during the course of our work. 


' HART has been audited numerous times by its financial auditors, the City and 
County of Honolulu Auditor, the Federal Transit Administration (FTA) via its Project 
Management Oversight Contractor, and other consultants. We reviewed these reports 
during the course of our fieldwork. 
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HART initially represented that we would have full and unrestrieted 
aeeess to doeuments and other information maintained in HART’s 
Contraet Management System and Mierosoft SharePoint platform. 

HART maintains the majority of its eontraet doeuments in this r 

eleetronie doeument management platform; however, we were not givenA 
aeeess to the Contraet Management System for months after our initi^y * 
requests, and the aeeess we were finally given was limited. Durim 
eourse of our audit, we repeatedly eneountered areas in the sysiW^hat 
we eould not aeeess, and despite repeated requests, HART refund to 
confirm that we had unrestricted access to its electronic re^^fls. 

We also experienced significant delays in receiving<<i^^^ents from 
HART and never received some documents that \^had requested, 
notwithstanding multiple follow-up requests. minutes of the board’s 
executive sessions that we did receive were^jfeeted so extensively as to 
render them indecipherable and meaning^i^ However, even then, 

’s executive sessions held 


HART only provided minutes of the^ 

from June 8, 2016 to September ri7. We had requested the minutes 
of the board’s executive session^fil^r the period January 2014 through 
December 2016. HART di^^^address or otherwise respond to our 
request for the minutes tiwNiMid not provide, i.e., from January 2014 
through June 2016. Basbdon the board meeting agendas posted on 
hart’s website, tlj|^bard held numerous executive sessions during 
that period. 

We wcK informed by HART staff that management had instructed 
its enjp^ees and consultants to audio record the audit interviews. 
Bqcause of that requirement, we were unable to obtain as complete 
tofiltered responses to our questions and other information as we 
•^^xpected. Despite repeated objections to the Board and management 
about the audio recordings, we were informed that the CEO continued 


his direction that staff and consultants record the interviews. 

We report these challenges and limitations on our information gathering 
in accordance with applicable government auditing standards. 
Notwithstanding these challenges, we do believe that the evidence is 
sufficient and appropriate to support the findings and conclusions made in 
this report. 

Our audit was performed from March 2018 through November 2018 and 
conducted in accordance with generally accepted government auditing 
standards. Those standards require that we plan and perform the audit to 
obtain sufficient, appropriate evidence to provide a reasonable basis for 
our findings and conclusions based on our audit objectives. We believe 
the evidence we obtained provides a reasonable basis for our findings 
and conclusions based on our audit objectives. 
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HART History=> 


Background 

Act 1, 2017 First Special Session 

During the 2017 First Special Session, the Flawairi State Legislature passed 
Senate Bill No. 4, which became Act 1, to provide the City with additional 
revenue sources for the construction of the Project. More specifically, Act 1 
authorized the City to extend the expiration of the one-half percent GET 
surcharge from 2027 to the end of 2030 and, beginning January 1, 2018, 
increased the TAT from 9.25 percent to 10.25 percent.^ Revenues from the 
surcharge on GET and one percent of TAT revenues are deposited into the 
Mass Transit Special Fund, which was created by Act 1 and is administered 
by the State Department of Budget and Finance. The revenues from the 
Mass Transit Special Fund can be used by FIART only for “capital costs,” 
broadly speaking, expenses directly related to construction of and land 
acquisition for the Project. 

In November 2010, 0‘ahu voters passed an amendment to tj^^vised 
Charter of the City and County of Flonolulu that set the^j^^work for the 
creation of FIART, a semi-autonomous public transit ^fh^ibrity, which was 
initially charged with the design, construction, op^tiOT, maintenance, 
and expansion of the fixed guideway rail transit s^sabm. Prior to the 
amendment, the Director of the City Departm^*of Transportation Services 
(DTS) was responsible for the planning,^6«^tion, and maintenance of 
all transportation systems on 0‘ahu. TM^harter amendment explicitly 
limited the DTS Director’s authoritf;<^rating that the Director “shall have 
no power, duty, or function witj^remect to transportation systems, facilities, 
or programs which are undep'S^^urisdiction of [FIART].” To carry out the 
Charter’s new mandate, a^Jl^'S Rapid Transit Division staff and functions 
were transferred to FIAROtlART began operating on July 1,2011. 

or^^oters approved an amendment to the Revised Charter 
unty of Honolulu that transferred responsibility of the 
aintenance of the rail system from HART back to DTS. 
RT now has an expiration date; once the rail system is 
ti?^7FIART’s mission will end. However, until then, HART is still 
sible for construction and completion of the rail system. HART’s 
recovery plan (November 19, 2018) estimates that the rail system 
fully operational in December 2025 at a cost no greater than 
$8,165 billion (excluding financing costs)."^ 


Funding Sources 
(in millions) 


2018 HART 
Recovery Plant 




In November 
of the City ai 
operation: 
Therefc 




^ Act 1 amended Section 237D-2, Hawai‘i Revised Statutes (HRS), by establishing the TAT 
at 10.25 percent for the period beginning January 1, 2018 to December 31, 2030. 

^ A comprehensive history of the Project can be found in Report No. 19-03, Audit of the 
Honolulu Authority for Rapid Transportation: Report 1. 

* While HART believes that its own cost estimate and schedule are achievable, HART has 
agreed to use the FTA’s recommended project cost of $8,299 billion (excluding financing 
costs) and opening date of September 2026. 



GET 

$5,990 



Beginning 

Cash 

Balance 

$298 


Other 

$13* 


Federal 

Grant 

$1,550 


’American Recovery and 
Reinvestment Act, interest income, 
and rent. 

** Numbers may not match due to 
rounding. 

Source: Office of the Auditor 
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HART’S Organizational Structure 




Board of Directors 

HART is governed by a 14-member Board of Direetors (Board). The ^ 
Board is the policy-making body of the authority and appoints and 
evaluates HART’s CEO. The Board approves HART’s annual operatj^ 
and capital budgets, a six-year capital program, rules and regulatiqffi^ 
and carries out other duties as authorized by law. 


The Feds are Watching ... and Reporting. 

HART’s $1.55 billion in federal funding comes with federal oversigi 








IN EXCHANGE for the Federal Transit Administration’s 
(FTA) commitment to provide $1.55 billion in funding 
under the New Starts program, the City and HART 
committed to completing the project on time, within 
budget, and in compliance with all applicable federal 
requirements. These mutual commitments are 
embodied in a binding contractual agreement - a 
Full Funding Grant Agreement, which was executed 
by the City and the FTA on December 19, 2012. 

The agreement places numerous conditions and 
requirements for the funding on HART. One of 
those requirements is participation in FTA projaqk^ 
management oversight reviews and evaluatiorSJf 
the Project’s various processes to ensura^^lactory 
progress is being made, as well as compliOTce with 
statutory, administrative, and regulat^^gjequirements. 
The FTA or its project managem^nSj^rsight 
contractor evaluates a projectdir ^ sure project 
sponsors, in this case the CHy\id HART, have the 
financial capacity to corq^teme project according to 
the terms of the Full R^JjaMg Grant Agreement. 

As of Novembei^0^!VlART has received 
$806 millioiHi^fWHunding, with $744 million 
awaiting E^X^proval for release of funds. 

One^T^e Project’s oversight reports, referred to 
aa^Tl^ refresh,” was released in October 2012, 
^tIeKo the execution of the Full Funding Grant 
/“Wtgreement in December of that year. The report 
noted that the project cost was kept at $5.12 billion 





n for future contracts and 


million, excluding esc: 
extended staffing 


Concerns abowScost containment and schedule 
maintenan^would persist in subsequent risk refresh 
reports ifj^14 and 2016. For instance, in the 2016 
repM^Ke FTA’s oversight contractor determined that 
HARQ cost estimates of $6.43 billion fell short of the 
^^A’s model by $1.19 billion. It estimated that the 
"^tal cost to complete the Honolulu Rail Transit 
Project would range between $7.73 billion and 
$8.02 billion and the opening date would be delayed 
from December 2022 until December 2024. 

According to the report, HART did not provide 
evidence that it “fully evaluated the costs of design 
changes, the schedule implications, the effects on 
existing construction contracts, and the political will to 
entertain any such changes.” 

According to the FTA, if at any time during its efforts to 
complete the project HART determines that the total 
project cost will exceed the baseline cost estimate, 
HART must immediately notify the FTA of the amount 
of the difference and the reasons for the difference. 
Further, HART must provide the FTA with a “recovery 
plan” that demonstrates it is taking and will take 
every reasonable measure to eliminate [recover] 
the difference between the total project cost and 
the baseline cost estimate. Requiring the submittal 
of a recovery plan is an action that neither project 
sponsors nor the FTA wants to invoke. 




despite the emergence of multiple issues that pushed 
up costs. Among other issues, the report identified 
that the suspension of construction due to an 
August 2012 Hawaii Supreme Court ruling could 
increase costs ranging between $64 million and $95 


In June 2016, the FTA directed HART to submit a 
recovery plan. In September 2018, the FTA directed 
HART to submit a revised recovery plan. 
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The voting membership of the Board is composed of the Director of the 
State Department of Transportation; the DTS Director; six volunteers 
from the community, three appointed by the Honolulu Mayor and 
three by the Honolulu City Council; and a ninth member of the Board 
appointed by the other voting members. These appointed board 
positions serve five-year terms. The term limit for these positions 
is two full consecutive terms or ten years, whichever is greater. The 
Director of the City Department of Planning and Permitting serves as a 
non-voting member. Act 1 added four more non-voting members to the 
Board, two of whom are appointed by the President of the State Senate 
and two of whom are appointed by the Speaker of the State House of 
Representatives. 




Chief Executive Officer 

The CEO is responsible for the performance of the entire HART 
organization and is directly accountable to the Board. The CEO 
manages the various areas of responsibility utilizing certain key 
managers, or “direct report” staff, many of whom are employo^or 
a third-party project management support consultant, as nota^^^ the 
organizational chart in Exhibit 1. In addition, the CEO i^rf^races with 
the Honolulu City Council and Honolulu Mayor, the.S»MtM)epartment 
of Transportation, the U.S. Department of TransportaHen, the ETA, 
and other relevant regulatory agencies. The CE(^^ also the “face” 
of HART, representing the organization with ♦general public, 
property owners impacted by the Project^Js media, and the design and 
construction industries. _♦ >^ 

Staff V 

During the period of our audiOv^T’s targeted project staffing was 
135 full-time equivalent st^^comprised of civil service and personal 
services contract HAR'fr^raployees and employees of HART’s third- 
party project man^<^^t support consultant, HDR. There is also an 
unspecified nurtffi^^f staff (not reflected in the organizational chart) 
from various ^jt^^epartments who provide support to HART. 

As of Novpmrar 2018, HART’s organizational structure consisted 
of 117 I^^^employees (112 personal services contract and 5 civil 
service)^d 18 HDR employees, totaling 135 staff. 

ir!W(?f)rding to HART, HDR employees are completely integrated into 
ShART’s technical and managerial positions. The CEO stated that 
HART does not draw a distinction between HDR employees and HART 
employees. HDR staff are highlighted blue in the organizational chart 
in Exhibit 1. 
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Exhibit 1 

HART’S Organizational Structure - Relating to Design and Construction 

This is a modified organizational chart based on charts provided by HART. 



Senior Project 
Officer 
Core Systems, 
Integration, and P3 
Project Delivery 


Chief Safety 
and Security 
Officer 


Operations & 
Maintenance 

Department of 
Transportation 
Services 












Director 
Quality Assurance 
and Quality 


Director 

Director 

Readiness & 

Project Delivery, 

Activation 

Integration & 


Testing 


(\n^uction 

Risk Manager 

Executive 

Management 

Project-Wide 

Support 




Manager 

West Arrf>^0 
Construc^\n ^ 





Manager 

Deputy Director 


Manager 

East Area 

Engineering and 


Third-Party and 

Construction 

Design 


Traffic Engineering 

c^♦ 






4 City 
Employees 

Deputy Area 
Manager, Production 
Program Manager, 
Closeout Manager 
(guideways), 
Assistant 


Deputy Area 
Manager 


Manager 
Engineering 


2 City 
Employees 

Production Program 
Manager, Assistant 
Area Manager 


CH2MHill (GEC) 

On-Call 

Coordinator 


3 City 
Employees 

Civil Geotech 
Engineer, PM 
Mapping, CADD/ 
Doc. Manager 


3CH2M 
Hill (GEC) 
Engineers 


Stantec (CE&I) 


Manager 
Project Design 


2 City Art 
Coordinators 


CH2M Hill (GEC) 
Lead Architect 


Manager 

Traffic Engineering 


4 City 
Employees 

Project Managers, 
Transportation 
Planner 


CH2MHiil (GEC) 
Traffic/MOT 


CH2M Hill (GEC) 
Senior Contract 
Manager 


Q HART Employee 
HDR Employee 

■ Third-Party Consultant 

■ Other 


General Engineering Consultant (GEC) 

Construction Engineering and Inspection Consultant (CE&I) 


Source: Office of the Auditor 
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HART Board 
of Directors 










n; 



HDR Executive- 
In-Charge 








Project 

Director 


Chief Financial 
Officer 


Director 

Project Controls 


CH2M Hill (GEC) 

Principal Advisor 


Director 
Transit Property 
Acquisition and 
Relocation 


Director 
Planning, 
Environmental 
Compliance 
& Sustainable 
Mobility 












First Deputy 
Executive 
Director 
Procurement, 
Contracts, and 
Construction 
Claims 


Deputy Director 

Project Controls 



CH2M Hill (GEC) 

Project Controls 


1 1 

Business 

Systems 

Manager 

Controls 

10 City 

Employees / 

Management ^ 
Analyst, Cost/Fffi!l^ 
Analysts, ^coi^^^ 


Analysts, Ss|Rdi^rs 

3 City 
Employees 

CMS Training 
Specialist, 

IT Support^^ 
Technician^^V 




Deputy Director 
Contract 
Administration 


Deputy 



7 City 
Employees 

Misc. Planners 
(Environmental, 
Mitigation, Land Use, 
Cultural Resources, 
Lead/Hazmat) 


Director 
Procurement 
and Consultant 
Contracts 


5 City 
Employees 

_ Contract Managers, 
Contract 
Management 
Assistants 


Contract 

Specialist 

Lea & Elliott 


Director 
Construction 
Claims, Utility, 
and Third Party 
Contracts 


3 City 
Employees 

Procurement and 
Specification 
Specialists 


Contract 

Specialist 

Stantec {CE&I East) 






O 




8 City 
Employees 

Right-of-way Agents, 
Planners, Land 
Document Technician 


Sustainable Mobility Lab 


CH2M Hill (GEC) 

Acquisition 
and Relocation 
Support 


Sustainability 
Planner 


Planning Construction 


Procurement 


4 City 
Employees 

Contract Manager 
and Assistant, 
Construction Claims 
Manager and 
Specialist 


Contract 

Specialist 

PGH Wong 
(CE&I West) 


Construction 

Claims 

Specialist 

Kobayashi Sugita 
& Goda 


Construction 

Claims 

Specialist 

HKA 


Construction 

Claims 

Specialist 

Arcadis 
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HART and Board policies delineating decision¬ 
making responsibilities are still in flux. 
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Per the Revised Charter of the City and County of Honolulu, the Board ^ 
exercises its policy-making authority through various means, including^>\ 
hiring/terminating the CEO, evaluating the CEO and determining 
his/her compensation, adopting and enforcing rules and regulatioi^^ 
pertaining to the organization and internal management of HA^^nd 
allocating decision-making responsibility between the Board atra HART 
management. In contrast, the CEO is responsible for adn^A^^ering 
“all affairs of [HART],” including signing all necessan^^ntracts, 
recommending to the Board the creation or abolisM^^t of HART 
positions, maintaining HART’s financial accounK^nd recommending 
rules and regulations for adoption by the Bqar^ 

cP 

Board’s increased oversight ^K^ority yet to be 
implemented. 

The original City Charter pro^Whs creating HART provided that one 
of the powers, duties, andJj^^ions of the Board was to “determine 
the policy for planningCSci^truction, operation, maintenance, and 
expansion of the fixed ^mdeway system.” The Board also had (and 
still has) the autho^^to adopt HART’s annual operating and capital 
budgets, a six-)^^*capital program, rules and regulations, as well as 
other acticpA^thorized by law. Prior to 2016, however, the Board’s 
authoriUO^ limited in the City Charter to the extent that "'neither 
the b(m^nor its members shall interfere in [any way] with the 
a(ktmistrative affairs of the authority.” Notwithstanding its otherwise 
^^^d authority to oversee HART, the Board believed that its primary 
^^^nethod of oversight of administrative matters rested in its ability to hire, 
evaluate, and terminate the CEO. 


In November 2016, the voters of the City and County of Honolulu 
approved Charter Amendment 4, which, among other things, expressly 
expanded the powers, duties, and functions of the Board to include 
oversight and decision-making over HART’s administrative operations. 

We asked the current Board Chair how the 2016 charter amendment 
has affected communication between HART and the Board. He said 
that the current Board is more involved in the day-to-day operations 
of the Project because, in the past, the Board was structured such that 
information about the Project was split among the Board’s subject area 
committees (e.g.. Project Oversight Committee, Finance Committee, 
etc.) rather than being presented to the entire Board. Now, he explained, 
the entire Board is receiving more reports and is notified of project 
updates as they occur, whereas in the past the Board would wait for the 
next board meeting to receive a project update. 
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Permitted Interaction Group proposes policy on Board 
oversight and decision-making. 

In October 2017, the Board established a Permitted Interaction Group 
to work on policies, rules, and regulations to implement its increased 
oversight authority. In September 2018, the Board’s Permitted 
Interaction Group issued its report and recommendations regarding 
how the Board should implement the 2016 charter amendment. The 
Permitted Interaction Group offered a proposed policy on the Board’s 
oversight and decision-making over HART’s administrative operations. 
The Board was expecting to vote on the Permitted Interaction Group’s 
report and proposed resolution in November 2018.^ 




Where the SiuA 
Don’t Shi^j^ 

THE HART 

subject to the Site’s open 
meetings^^^commonly 
referre^^i^s the “Sunshine 
»>J^rt I of Chapter 92, 




Generally, Board approval is required for all policy decisions pertaining 
to HART and for actions otherwise specified by law. The Permitted . 
Interaction Group recommended that the scope of Board oversight 
administrative operations should focus on HART’s ability to com^l^ 
the Project by the Board-approved opening date and within the>^ancial 
plan. Similarly, in regard to decision-making, the group rec^Eitiended 
that the Board’s role should be limited to actions that affftJt^ART’s 
ability to complete the Project. The recommended p^l^ explicitly 
states that all other administrative matters shall be wi™n the discretion 
of the CEO and his staff 

The group also recognized that the BoanB^xisting rules do not specify 
actions requiring Board approval (an^are^^e explore further below). 
The group recommended a list of IJs^t^s which would require Board 
approval: 

• Certain arrangemqtt^nd agreements with the federal 
government and\i^ any public entity or utility 

• Change ordw^ril excess of $ 1 million or which could have a 
significaT^^ajfpact on the “critical path” of the Project 

• Ope^^^ and capital budgets 

• JS^^ar capital program 

Additions and deletions of contract packages relating to the 
annual operating and capital budgets and six-year capital 
program 

• Appropriations, grants, loans, and gifts 

• Appointment and removal of the CEO 

• Issuance of the annual report 

• Creation/abolishment of positions within HART 


5 ,' 




a^i‘i Revised Statutes, 
a government board, its 
discussions, deliberations, 
decisions, and actions must 
be conducted as openly 
as possible, with public 
notice and an agenda of its 
meetings posted in advance 
and minutes reflecting the 
substance of the board’s 
actions. There are certain 
limited exceptions that allow 
board members to privately 
discuss board matters, 
without keeping minutes 
of those discussions, one 
of which is a “Permitted 
Interaction Group.” That 
exception allows two or more 
board members, but less 
than the number needed 
for quorum, to “investigate” 
a matter relating to the 
official business of the 
board, so long as the group 
is created and the scope of 
its investigation is defined 
at a board meeting. The 
Permitted Interaction Group 
also must present its findings 
and recommendations to the 
entire board for decision¬ 
making, if any. 


^ After the conclusion of our fieldwork, the Board adopted the Permitted Interaction 
Group’s report and proposed resolution as Resolution No. 2018-14 on November 15, 2018. 
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• Selection of the Board’s ninth voting member 

• Contracting for the annual independent financial audit of HART 


• Eminent domain actions 

• Bond sales 

Despite recent Board actions clarifying lines of 
authority, gray areas may persist. 






5 ^ 




cr 




The appropriate division of responsibility between an or^^hjhtion and 
its governing board is subject to some interpretation., AQswding to the 
American Public Transportation Association’s Trai^^^oard Member 
Handbook, the distinction between governance management is 
complex, dynamic, and not absolute; the roR^^tne CEO and board 
members occasionally and naturally enteiAK>other’s domain. 

However, we found that certain asp^pSSjf those respective roles 
have yet to be clarified. For insta^eTTf ART’s internal policies and 
procedures establishing the pro^©^ for communicating information to 
the Board, as well as policia^utlining what project information must 
be brought before the BWrsior decision-making, have not been revised 
in more than six years. »ut, more importantly, we identified two issues 
which appear to fa{^fthin a gray area of HART governance. We 
believe that theigyinatters either critically affect or fundamentally alter 
the way theC^ority operates and therefore should be reported and 
vetted, ^st^d, according to the CEO, the decision-making authority on 
these |i<^k^rs fell well-within his purview, giving him the discretion to 
reoort to and consult with the Board - or not. 

withholds contingency amounts from budget 
<y^eporting. 


Construction contracts, especially for a project the size and complexity of 
the Honolulu Rail Transit Project, cannot anticipate every issue that the 
contractor may encounter once work begins. For instance, often project 
conditions may differ from what was reasonably anticipated by both the 
project owner and a contractor; a contractor may incur additional costs 
because of delays to its scope of work that are caused by others. 

To cover these unexpected costs, HART includes a “cushion” or 
“reserve” as part of the total amount it budgets for each contract, 
both awarded and anticipated. Those funds, referred to as “allocated 
contingency,” vary in amount, depending on the contract’s scope of 
work and/or the risk associated with the work. (For a further description 
of contingencies, see “The Budgeted Contingency: Expecting the 
Unexpected” on page 13.) However, we found that HART does not 
include the allocated contingency when it publicly reports the budget 
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for a particular contract or phase of work. Although HART reports the 
cumulative total contingency that it has allocated for all its contracts, 
HART does not disclose contract-specific contingency amounts, even to its 
own Board. The CEO justifies this decision to withhold the information 
because he believes that disclosure of the allocated contingency for a 
specific contract will result in higher project costs. According to the CEO, 
if contractors know how much contingency has been set aside, they may 
seek change orders to exhaust the contingency. 


However, it is because costs have greatly exceeded the amount budgeted 
for certain contracts that HART has needed additional funding. Starting 
with the Project’s very first construction contract - the $483 million 
contract to Kiewit Pacific Co. (Kiewit) - the allocated contingency 
has been tapped and often exceeded for many contracts. In Report 
No. 19-03, Audit of the Honolulu Authority for Rapid Transportation: 
Report 1, we chronicled the Project’s turbulent financial history, rep 
that the original budget of $5.122 billion included $644 million 
project contingency, but the delay claims and other unexpected^sues 
associated with certain of those first contracts resulted in $3S^)nillion in 
change orders.'’ HART incurred almost $198 million in i»®Jpected costs 
relating just to the Kiewit contract. 






5 ^ 

















’ In total, approved change orders total over $559 milli(^py^ of December 2018. 


The Budgeted ContliVgency: Expecting the Unexpected 


IT IS IMPOSSIBLE to predife^^the variables that 
may be encountered dum^a project the size and 
complexity of the HotMl^ Rail Transit Project. 
Lawsuits, unantici^teJlsite conditions, property 
acquisition, utiktja^cation, market fluctuations, 
delays - poteatier road blocks and their related risks 
are myri V 

A mj^^^f mitigating such challenges - expecting 
tK^j^xpected - is to build an analysis-based 

C y^omingenoy into the project’s budget, adding moneys 
the estimated project cost to absorb the impacts 
of risks and to cover cost overruns. An effectively 
' managed contingency helps ensure that cost 
adjustments associated with risk can be covered 
without having to seek additional or new funding. 

The amount of project contingency is directly related 
to the risk associated with completing a particular 
scope of work. In the case of the Honolulu Rail 
Transit Project, the original budget of $5,122 billion 
included $644 million in contingency funding. 


Contingency moneys would be tapped early and 
often. In November 2009, the City executed a 
$482.9 million contract with Kiewit to design and 
build the West O'ahu Farrington Highway portion of 
the guideway, the system’s first 6.5 miles, from East 
Kapolei to Pearl Highlands. In June 2011, Kiewit 
was also awarded a $372.2 million contract for the 
construction of the 3.9-mile Kamehameha Highway 
guideway, which stretched from Pearl Highlands to 
Aloha Stadium. Also, that month, the City awarded 
a $195.3 million contract for the train’s maintenance 
and storage facility to Kiewit/Kobayashi. Construction 
of the West O'ahu Farrington Highway guideway did 
not start until April 2012. 

The “unexpected” - for example, lengthy 
environmental review, lawsuits and an unfavorable 
court decision, and poor planning - contributed to 
$312.3 million in change orders, eating up nearly half 
of the Project’s original contingency budget. 
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Despite the Project’s heavy reliance on its contingency, each year 
we found that the Board is asked to - and does - approve HART’s 
construction budget, which includes a list of each executed and 
unexecuted contract anticipated to complete the Project with the 
corresponding budget for each, minus the allocated contingency. 


Without the allocated contingency, the Board does not know the tot^^ 
amount HART has budgeted for the scope of work under each^(!^act 
and does not know whether the actual construction costs excee^d 
the amount that HART had budgeted for that work. With^t^his 
information, how can the Board ensure that the CEO. i»^feountable for 
the work being completed within a contract’s budg^|?^ow does the 
Board ensure that the Project stays on budget? I^jv does the Board 
assess HART’s budgeting process? v 

HART has pledged to be more transp^R^in its operations. 

Considering the Project’s estimated<5^^as swelled almost 80 percent 
to $9,188 billion, we agree that tr^sparency is paramount. Although 
we understand the CEO’s conc^^, we question whether the CEO has 
sufficiently considered the interest in the entire budget for each 

contract, especially giv^j^^e Project’s history and the greatly expanded 
amount of the Project’s o&sts that State residents and visitors are now 
obligated to fund, ^i^public policy determined by the Eegislature. The 
HawaiT Suprenr^(Tourt recently reaffirmed the State’s policy requiring 
“[o]pening.d^he government processes to public scrutiny.”^ 






.cr 




We alp<^^sagree with the CEO that disclosure of the allocated 
contingency will necessarily result in higher project costs. According to 
^^C^Q”s Contract Change Procedure, HART assesses every change order 
^j^eeking to increase the contract amount for “merit.” Without that finding 
of merit, HART will reject the change order. That requirement - i.e., 
merit for additional moneys - should not change even if the contractor 
knows the amount of allocated contingency associated with its contract. 


Decision to pursue public-private partnership to complete 
construction was left to the discretion of the CEO. 

In September 2018, the Board voted to support HART’s plan to pursue 
a public-private partnership, commonly referred to as “P3,” to help pay 
the $1.4 billion cost of the City Center Guideway and Stations segment 
of the Project and build the Pearl Highlands Parking Garage and Transit 
Center. This matter was brought before the Board despite some HART 
managers’ belief that the issue did not need approval since it was a 
matter of “project delivery,” an area outside of the Board’s authority. 


’ Peer News LLC, dha Civil Beat v. City and County of Honolulu, — Hawaii —, 

— P.3d —, No. SCAP-16-114 (December 21, 2018) (quoting Section 92F-2, HRS). 
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To P3 or not to P3? 

HART’S midstream pivot to a P3 project deiivery modei raises more questions 
than answers. 






CONSTRUCTION OF THE RAIL PROJECT 

to date has used a conventional design- 
build model in which HART enters a fixed- 
price contract with a construction firm and 
makes progress or “milestone” payments 
as construction is completed. However, in 
September 2018, HART’s Board of Directors 
approved the use of a new model for the 
design, construction, and financing of the 
system’s City Center Guideway and Stations 
segment (Kalihi to Ala Moana Center) and 
Pearl Highlands Parking Garage. Under this 
new model, commonly referred to as a public- 
private partnership, or “P3,” HART enters 
into a contract with a developer, which then 
partners with construction, operating, and 
financial partners who have the responsibility, 
and the associated risks, of delivering the 
Project. In addition, the private partner wilU^* 
given a 30-year concession to maintair^im 
operate the entire system. The Citvj;e|^s 
the developer for construction co«» 4 J^ing 
tax revenue sources and, unlik^nS^present 
model, payments continue fprfiyb years after 
construction is completed. ' 


for decades and, more recently, in the UnjI 
States by such cities as Denver, Los Anc 
and the suburbs of Washington, D.S^fjj^ever, 
HART will be introducing a new de(^^y model 
midstream, with the rail’s segments 

under one model and its le segments 

under another. AccordinSTo RART’s 
November 19, 2018, R^&^ery Plan, the 
completion of the guideway and 

finalization of WeeQWde contracts and related 
systems instg.l|igHbn will not be included under 
the P3 con 


HART’S choice of P'^Hpfesents a shift in 
the completion oi^^^roject and eventual 
operation ar^ fhQj)itenance of the rail system. 
According t^ 2018 analysis of the commercial 
viability cfi^jmNc-private partnerships 
cornmifefsned by HART, by transferring key 
proj^^^elivery risks to the private sector, P3s 
certainty of on-schedule, on-budget 
^^(jfivery, as well as provide long-term operating 
^ost reliability. The analysis also claims that 
the size and scope of a P3 for the Project could 
attract major international firms, which could 
promote competition and “directly harness 
global best practices and drive innovation.” 

According to HART, P3s have been used by 
numerous major transit projects internationally 


Ther^^ also questions regarding the 
CitvsyWe in operations and maintenance of 
^K^IProject once construction is complete. 
^✓Njr instance, in 2016, with the passage 
V^of Charter Amendment 4, operations and 
maintenance responsibilities were shifted from 
HART to the City and County of Honolulu’s 
Department of Transportation Services. In 
its November 19, 2018, recovery plan, HART 
was unclear exactly how the P3 approach 
would change responsibilities for operations 
and management, but it appears that the 
Department of Transportation Services will 
now have an oversight role over the eventual 
P3 vendor, who will be given a 30-year 
concession to operate the rail system. Terms 
of the allocation of risk between the City and 
P3 developer, and terms of the developer’s 
concession to operate and maintain the 
Project, have yet to be negotiated. 


Those opposed to P3 conversion claim 
that there is no evidence that P3 reduces 
construction costs and can be used to avoid 
debt limits. Opponents also claim that in order 
to make money off of the partnership, a private 
partner would insist on structured payments 
that would guarantee a set amount of income 
each year, instead of payment based on ticket 
revenue. 
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But the CEO felt that switching to a public-private partnership was 
a significant decision that should go through the Board. He believes 
that anything related to policy or that would enhance transparency 
is something that should go to the Board. When things are “on the 
bubble,” the CEO considers whether bringing them before the Board 
will help rebuild trust in the Project. 




While we support the CEO’s effort to restore public confidence C^ugh 
transparency, we believe that the transition to P3, an entirely different 
business model, represents a fundamental shift in not onlv^h^tV HART 
delivers the Project but how it will operate. A matter ^Qroh critical 
importance should not be left to the discretion of th^,^^0. 



Consultants 
ther third-party 




.cr 






HART relies on third-pa 
to oversee and mana 
consultants. 


As of November 2018, HAR^JJ^organizational structure had 117 HART 
employees (112 persond^^S^ces contract and 5 civil service) and 18 
HDR employees, its thiii^^arty project management support consultant. 
While HDR emplo)^»make up a relatively small percentage of HART’s 
total staffing, they ^rve in critical positions overseeing the final design 
and construc^on^ff the Project and include the Project Director; Senior 
Project Of^^rof Core Systems, Integration, and P3; Director of Design 
and Co1^0nction; West and East Area Construction Managers; Director 
of Project Controls; and Risk Manager. Other HDR employees also 
_^&o^in other director, manager, and deputy director/manager positions. 

According to HART, HDR employees operate as an extension of HART 
staff and are completely integrated into the organization. Although 
hart’s organizational chart and culture may not differentiate between 
HART employees and those of HDR, these embedded consultant 
employees are employed by a private, third-party organization, not 
HART; they are paid and evaluated by their private employer, not HART. 
In addition, many HDR employees directly oversee the work of other 
third-party consultants, some of whom are also HDR employees. 


The predominance of third-party consultants in HART’s upper 
management has been an ongoing concern for the ETA. In its 2014, 
2016, and 2018 Risk Refresh reports, the ETA recommended that key 
management positions be transitioned from third-party consultants to 
HART employees in order for the organization to “have more ownership 
and maintain stronger continuing control of the project.” As part of 
its risk assessment process, the ETA assigns a project management 
oversight contractor to evaluate the reliability of the project scope, cost 
estimate, and schedule, which includes an updated “risk refresh” report 
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At the Heart of HART 

As the FTA noted, HART’s current structure does not provide 
adequate levels of ownership and control over the Project. To 
provide more accountability, the FTA repeatedly recommended 
transitioning FIDR employees into FIART positions. The following is a 
breakdown of FIDR employees relating to design and construction in 
FIART’s upper management. 






□ .ON' 
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Source: Office of the Auditor 


1. Project Director 

The Project Director, who reports to the CEOy4»^ponsible 
for design and construction, right-of-way, nlamwg, project 
development, project budget, schedule risk 

management, contingency management, and dispute 
resolution. The Project Director i&S&^esponsible for 
managing Full Funding Grant A^^ment compliance. 

2. Director of ProLefttJJontrols 

The Director of Project^r^rols reports to the Project 
Director and is resi : for overseeing all cost 
estimating, cos^SJSgement and control, scheduling, 
document contw^anagement information system, and 
reporting agft^H^j^s within the Project. 

^st^Manager 

^k Manager reports to the Project Director and 
^ctly responsible for developing and administering 
Risk and Contingency Management Plan by 
reviewing and approving any changes made to existing 
risk and mitigation strategies, providing risk management 
input to Project Controls on the necessary level of allocated 
contingency, and developing risk management reports. 



4. Chief Safety and Security Officer 

The Chief Safety and Security Officer is primarily 
responsible for the development, coordination, and 
implementation of the Project’s Safety and Security 


Management Plan which describes the policy and 
methodology to ensure safety and security for 
passengers, employees, and the general public. 

5. Director of Quality Assurance and 
Quality Control 

The Director of Quality Assurance and Quality Control is 
responsible for the development and implementation of 
FIART’s Project Quality Management Plan. The director 
reviews and approves each consultant, contractor, and 
supplier’s individual quality assurance plan to ensure that 
their respective plans meet the FTA requirements and 
FIART’s own Quality Management Plan. 

6. Director of Design and Construction 

The Director of Design and Construction is responsible 
for project development activities related to design and 
construction. The director’s specific duties include 
overseeing all project design, construction, and 
inspection, and adhering to the Project’s construction 
budget and schedule. 

7. Area Construction Managers 

The Project is divided into two distinct sections, the West 
and the East, with each under the oversight of an Area 
Construction Manager, who is responsible for overseeing 
the delivery of the Project and managing consistency 
across the various contracts within his/her respective area. 
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which represents the FTA oversight contractor’s assessment of Risk and 
Contingency Management. 


According to the CEO, HART hires third-party consultants to fill HART h 
management and staff positions rather than City employees because it is 
unable to find highly qualified candidates willing to accept a City salary^ * 
for the positions. The fiexibility to attract and hire appropriately quafi^d 
applicants is also the reason why HART stopped hiring civil 
employees in 2016. In addition, since the construction of the raiftystem 
has a finite duration, it is the CEO’s contention that HART^wii^Aventually 
“work its way out of business,” and he does not want tO/i(a3n a position 
where it will have to terminate civil service employ^^^M the conclusion 
of the Project. As a result, HART pays HDR $9.^^ilhon per year for, 
on average, 19 embedded HDR employees at ^^nnual average cost of 
$505,260 per HDR employee as depicted i^^ graphic on page 22. 

er the fact. 


HART oversight: reactive 






.cr 




Our review of HART’s oversig}^^ third-party consultants, including 
those hired to fill many of tW^oject’s key management positions, 
showed a lack of consist^SIollow-through and monitoring of 
performance. This was^^arent even where HART identified 
deficiencies in per^^ance and communicated them to their contractors. 

In July 201^^^^T’s then-interim CEO sent letters to third-party 
consultmits^cluding HDR, CH2M Hill, Inc. (CH2M Hill), PGH Wong 
Engirj^^Mg, Inc. (PGH Wong), and Stantec Engineering, Inc. (Stantec), 
dii^cting them to conduct evaluations of their own performance under 
Xh^^espective contracts and provide feedback to HART. For three 
the four letters, HART called attention to specific deficiencies that 
required remediation. 


hart’s letter to HDR alleged that HDR “has not enforced and ensured 
satisfactory delivery for the Project.” Specifically, HART claimed 
that HDR staff failed to “enforce contractual terms, such as seeking 
indemnification against third parties when they fail to perform work on 
time causing delays to other contractor’s [sic] work.” As HART noted 
in its letter, unlike other consultants working on the Project, HDR’s 
primary and overarching task is to oversee the successful design and 
construction of the entire Project. 

In its letter to CH2M Hill, HART’s General Engineering Consultant, 
HART asserted that “there was no Master Schedule for the Project” and 
that, in 2017, “there was a serious deficiency in the areas of interface 
management and coordination and design management.” As a result, 
HART believed that CH2M Hill’s “lack of action on issues related to 
interface and schedule-driven performance of work in the field has 
resulted in cost and schedule impacts to the Project.” 
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Three Degrees of Separation 

HART uses third-party consultants to manage 
third-party consultants to manage construction. 





PGH Wong Engineering, Inc. / Stantec Engineering, Inc. 

THE PROJECT is divided into two distinct sections, the East and the West, each 
under the oversight of a construction engineering and inspection consultant. 
PGH Wong Engineering, Inc. (PGH Wong) serves as HART’s consultant for the 
Project’s West area. Stantec Engineering, Inc. (Stantec) oversees the Project’s 
East area. These consultants provide key specialty resources for strategic 
efforts, including construction support, design and constructability reviews, 
systems integration, permitting, and stakeholder liaisons. Each construction 
engineering and inspection consultant is overseen by a HART Area Construction 
Manager - an HDR employee. 
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In other words, the 
buck stops at HDR, and 
perhaps, as a result, 
HART oversight comes 
in the form of a “get- 
your-act-together” 
letter. 


In response, some of the third-party eonsultants ehallenged the aeeuracy 
of hart’s assertions. For instanee, HDR responded that HART’s letter 
eontained statements that were not only ineonsistent with the history of 
the Project, but also inconsistent with HART’s own assessment of its 
work when it signed a new contract with HDR on January 1, 2017. 

Moreover, HDR noted that “at no point since the initiation of th«Oj> 
Project was HDR considered by HART or others to be a cause « cost 
or schedule increases.” Similarly, CH2M Hill noted in its^^l^onse that 
the feedback it had received from HART over the past^^ee years had 
been favorable. CH2M Hill also suggested that th^mCTim CEO lacked 
the context and background of the contract term^smd conditions, as well 
as the status of implementation to that point. JjSjuly 2017, the interim 
CEO had been with the Project for approxji^Jely seven months. 




.cr 
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HART’s interim CEO believed that t{J^)«x)gress of the Project justified 
his writing of the letters. Despite*i^nmying numerous deficiencies and 
receiving responses from the HART did not implement an 

action plan to address these d^mencies. In addition, HART was unable 
to provide any memoraiMj^lsi^ritten evaluations of the consultants to 
support the assertions iirfiie letters. We also learned that HART does 
not conduct formal^^ormance evaluations of any of its third-party 
consultants or th^*employees assigned to the Project and does not conduct 
an evaluatkj^^ any of its third-party consultants’ performance at contract 
closeouLfli^RT’s interim CEO explained that, rather than analyzing 
the pa|s^ih!b wanted to move the Project forward and communicate to the 
c^^ltants that each needed to “get their act together.” 

September 2018, the current CEO informed us that HDR had recently 
agreed to conduct internal evaluations of its employees assigned to the 
Project. HDR will also offer HART “insight” into how better to structure 
and manage the Project from an organizational perspective. This change 
is in contrast to the services HDR provided in the past, which the current 
CEO likened to a “body shop,” or a staffing agency that only provided 
people to fill positions. Now, HART expects HDR to recommend where 
staffing redundancies can be eliminated and how the organization can be 
streamlined to prepare for changes like the public-private partnership. 

HART’s CEO acknowledged that HDR’s internal evaluations of its 
own employees are not shared with HART. As a result, awareness of 
employee or section performance does not percolate to the CEO. In 
other words, the buck stops at HDR, and perhaps, as a result, HART 
oversight comes in the form of a “get-your-act-together” letter. In 
addition, according to the interim CEO, HART’s organizational 
structure (i.e., HDR employees supervising other HDR employees and 
other consultants) makes management of consultants a greater concern 
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than it would be otherwise. He reealled instances where consultants would 
try to shift blame to other consultants - a situation he felt occurred more 
frequently because of the number of consultants on the Project. 


HART relies on consultant to determine whether its own 
staff’s work is satisfactory. 

hart’s process to review third-party consultant invoices for payment 
relies heavily on the work of two key people: the contract manager and the 
project manager assigned to the specific consultant’s contract. The contract 
manager is the “first reviewer” and is responsible for reviewing invoice 
documentation for compliance with contract terms and conditions. The 
project manager subsequently certifies that all work invoiced was performed S 
in accordance with the contract terms and any materials/deliverables were 
accepted by HART. The project manager is also responsible for verifyin^^ 
that the invoice is accurate and complete and that the work invoiced 
accomplished during the period. 

hart’s First Deputy Executive Director (First Deputy) servfj^ the 
project manager for the HDR contract. Although she has s^nsive 
procurement experience, her professional background^^ported in the 
November 2018 Revised Recovery Plan, does not in^l^e experience in 
managing construction projects, design/engineerm^work, or other areas 
where HART has concluded that third-party cxmjvutants are needed for their 
technical expertise. In addition, she is not^cMirect supervisor for any of 
the HDR employees. 

Because HDR staff perform work a^mbedded employees in the 
organization, HART’s contr^'^^ HDR requires that each HDR employee 
provide a narrative log of hi^^r tasks and deliverables achieved during 
each month. In addition,'*^ contract states that the description should 
justify the hours bill^ Notwithstanding this contract provision, we found 
that when the emp^i^narrative logs are reviewed, it is not a review for 
appropriatene^ work. For example, if the narrative log for an Area 
Constructionli^nager indicated that he did not visit the field at all during 
a given nA*f the project manager will not question his decision to spend 
his tim^wmat manner. Rather, determining whether HDR staff work is 
apj^DBrihte is left to the HDR staff’s supervisor in the organizational chart, 
mnother HDR employee. 

'Rart believes that this level of invoice review is appropriate given that 
all HDR employees report to a supervisor who provides oversight of that 
employee. Additionally, HART explained that HART’s Project Director 
- also an HDR employee - signs off on every HDR employee’s hours to 
certify that the work performed is appropriate. 


The First Deputy is expected to review the logs from, among others, the 
Project Director, Quality Assurance Manager, Risk Manager, Director of 
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Highly Placed, Highly Compensated 

While HDR employees make up a relatively small percentage of MART’S total 
staffing, they serve in critical project management positions. According to the 
CEO, HART hires third-party consultants rather than City employees to fill these 
positions because it is unable to find highly qualified candidates willing to accept \ 
a City salary. The predominance of third-party consultants in HART’s upper 
management has been an ongoing concern for the FTA. 






1 HDR Employee 

A - .. 


iir 


Contract with HDR for Project Management^^)' 
Support Consultants 

•<A 

19 HDR Employees (on avera^|^ 

u-OffiO 




Monthly Cost 

$ 42,105 

Annyai-Sost 

Cf505,26^ 

) 

Each HDR ^ 
employee costs 
HART $505,260 
per year. 

This amount includes 
direct labor costs, fringe 
benefits, and general y 
overhead. 




Monthly Cos^^800,000 
Annual ^^9^ million^ 


cito th( 


The numbers above>«jc 

in 2018. O' 

Auditor 


the left are based on average monthly HDR staffing costs 


Source: Offic 






we c 


and Construction, and Area Construction Managers. However, 
also learned that she only reviews the narrative logs once every 
three months. 




cr 




HART did not find it problematic that the Project Director is himself 
an HDR employee. When we asked whether it would be unreasonable 
for HART to retain a third-party or another consultant to ensure a more 
thorough and objective review, i.e., so that someone with experience 
in large construction projects - other than someone employed by 
HDR - is reviewing the HDR invoices, the CEO told us that it would 
come down to whether hiring additional staff to review invoices would 
provide enough value to justify the cost. The CEO did not believe that 
the possible savings from retaining an invoice review consultant would 
outweigh the costs to retain such a person. 

However, we note that, between January 2018 and October 2018, HDR 
submitted requests for payment approximating $800,000 per month. 
hart’s process for spot-checking HDR invoices once every three 
months means that two months of invoices, approximately $1.6 million 
in payments, are approved with minimal verification that HART is 
receiving a fair or accurate bill. 
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HART does not retain complete documentary evidence 
of its quality assurance audits of consultants. 

According to the FTA, the function of project and construction 
management is to assure acceptable quality while executing the project 
on time and on budget. To achieve this, the FTA requires that HART 
prepare a quality plan, which contains HART’s quality policy, objectives, 
and written procedures governing quality assurance and quality control. 
Accordingly, HART developed a quality management plan that provides 
the controls for design, procurement, construction, inspection, and 
testing, which will enable HART to be assured that the quality necessary 
for safe and reliable operation of its transit system is achieved. Among 
other things, the plan requires contractors, consultants, and suppliers 


The FTA’s Quality 
Management Sysfs^ 
Guidelines defin^s^uality 
control as thSCtechniques 
that are ij«e^To assure 
that a jn^uct or service 
m^t^J^quirements 
an^hat the work meets 
product or service 




ULiici Liimgs, Liic piaii icquiics i^uiisuiLauLs, aiiu suppiicis vOS^oalS ” GeOerallV thiS 

providing design, engineering, construction, items, and services to HART^^^ ^ ' ,, r. 

refers to the act of taking 

measurements, testing, 


to submit a quality assurance plan that is applicable for their respectivi 
scope of work for HART’s approval. HART, however, is responsi^Jff^ 
for maintaining quality assurance oversight and conducting audtt^Oi the 
consultants, contractors, and suppliers. 


To that end, HART quality assurance audits are planne^»^heduled, 
and performed to verify compliance with the respectN^contractors, 
consultants, or suppliers’ quality management sysff^ and contract 
requirements. Per HART’s audit procedure, tt^T staff must conduct 
audits using a specific checklist. Moreov^^according to HART, 
the audits follow a standard audit procejQ^ including entrance 
meetings, exit meetings, and prepam^^^of audit reports. Once audit 
work is completed, the audit team pr^ares an audit report along with 
documented observations an^^^Ji&gs. 

As we state in our audit^^^ive, our work focused on HART’s 
oversight of consult^^. no that end, we reviewed the quality assurance 
audits of four con^I^^ffts: HDR, CH2M Hill, PGH Wong, and Stantec. 




HART’s QiMiB^Assurance and Quality Control division provided the 
files in m^jmK^blders with the name of the consultant and the year of 
the audj^-^mer hand-written or printed on the top of the folder (e.g., 
“Sl^>ec 2017”). While some of the quality assurance files are maintained 
djat^nically, HART explained that the physical file typically contains 
completed audit checklists, meeting agendas, schedules, audit reports, 
and any nonconformance reports or observation reports. None of the 
documents we reviewed was identified or organized in a consistent manner. 


and inspecting a process 
or product to assure that 
it meets specification. 
Quality assurance, by 
contrast, refers to the 
actions at a management 
level that directly improve 
the chances that quality 
control actions will result 
in a product or service 
that meets requirements. 
These actions include 
adequate planning, 
ensuring that contractors 
are capable of meeting 
and carrying out quality 
requirements, and 
documenting quality efforts. 


Additionally, while reviewing the physical files, we came across 
numerous instances of incomplete Quality Assurance audit checklists. 
Where the files contained some notations, some were illegible. Further, 
there were no dated signatures indicating who performed the work to 
verify the elements on the audit checklist. 
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Checking the Checklists 


TO VERIFY compliance by contractors, consultants, or suppliers with their 
respective quality management systems and contract requirements, HART 
staff conduct quality assurance audits using checklists. In our review of the ^ 
checklists related to CH2M Hill, PGH Wong, and Stantec, we found numerous 
incomplete entries, illegible notations, and missing signatures. When we 
inquired about these discrepancies, HART told us that its quality assuraQce staff 
only indicate an observation or comment when they identify a deficienw^^t we 
found that this is not always the case. 




No. 

Questions 

Reference 


POS 

NCR 

3.5 

How do the CE&I and GEC3 interface with each other? 




3.60 

Do design reviews address constructability, operability, > 
maintainability, reliability, and availability? ( 




3.70 

How does the CE&l assure that materials and equipment v 
specified in drawings and specifications comply with Buy ( 
America, Ship America, and Fly America requirements? ^ 

is 



3.80 

How are field and design changes properly controlled and ^ 

implemented? J 




3.90 

How is configuration control maintained, and are the latest . 

design document revisions clearly identified? /V 




3.10 

Are final design drawings and reports certified bv^Hkj^ ^ 

appropriate Professional Engineer (P.E.) or Archi»t^^ 
registered in the Stale of HawaiM? 










deficiencies, not compliance. 




cr 








O' 




No. 

^^^^yjueations 

Reference 

Compliance 

POS 

NCR 

OBS 

10.2 

Does CE&!^ril)uhtt inspections are performed by qualified 

personiA^rotiiinzaiions in accordance with approved 

procedura^V 


^ -illegible notation 


10.3 

How does the CE&I ensure that work performed by 

lUKonlractors, consultants, and suppliers is inspected? 


^ (wV‘'X 


IS 

DSes CE&I verify that required inspections are incorporated 

into an Inspection and Test Plan (ITP) which includes HART 





No. 

Questions 

Reference 

Compliance 

POS 

NCR 

OBS 

sue 

12.0 

Element No. 12 - INSPECTION, MEASURING, & TEST 
EQUIPMENT 


12.0 

Does CE&I verify that quality and safe^-related 
measuring/testing devices (tools, gauges, instruments, etc.) 
are controlled, calibrated, and adjusted to maintain accuracy? 




12.1 

Does the CE&I verify that calibration is traceable to the 

National Institute of Standards and Technology (NIST) or 
manufacturer recommendations? 




12.2 

Does the CE&I verify (hat measuring and test equipment 
identified by equipment number and marited to indicate 
calibration status? 


j’sc 


12.3 

Does the CE&I verify that records of equipment issuance and 
calibration are properly kept and maintained? 




12.4 

Does CE&l verify that when inspection, measuring, or test 
equipment is found to be out of calibration, is the validity of 
previous inspection and test results assessed and documented? 


_ 



incomplete entry 


Source: HART 
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When we asked HART about these discrepancies, we were told that 
the blank boxes indicated that the consultant had satisfied the element. 
Further, despite some boxes having “Yes” notations in the checklist, 
HART asserted that its quality assurance staff only indicate their 
observations/comments when they identify a deficiency - otherwise 
the consultant is fine. 


Conclusion 

It takes a large, complex organization to administer a venture the size 
and scope of the Honolulu Rail Transit Project, and HART, like the 
$8,165 billion (excluding financing costs) project it manages, is still 
a work in progress. In November 2018, HART’s Board approved 
Resolution No. 2018-14, which, among other things, clarifies the 
division of responsibilities between HART’s CEO and the Board. 
However, some gray areas of governance still exist. For examp^^ 
we found that the CEO still maintains considerable discretioi\<i2^hat 
to report and when to consult with the Board. We identifiafl^cent 
issues that either critically affect or fundamentally altes^heway HART 
operates and therefore should be reported to the Boarmsnd fully vetted. 
Yet the CEO continues to have the power to cho^^^^vhether or not to 
affirmatively present information on these iss " ^ ' 


Q: How does HART 
avoid a conflict 
of interest when \ 
auditing its contr^a^ 
with HDR? 

A: It doesn’h^dit the 
contract^** 

SINC 

geo 





eri' 




to the Board. 


We also found that, when it comes to Ih^fcsign and construction 
of the Project, HART is an organiz^^^o of “consultants managing 
consultants;” oftentimes a manager and those managed are employees 
of the same third-party consul^a\u Since employee evaluations 
are not shared with HARTi^^areness of employee or section 
performance does not p^i^^ate to the CEO. In other words, the buck 
all too often stops ^^^^nsultant, not with HART. 

As the FTA n^^^lling key positions with third-party consultants 
rather than<H^?T’s own employees is less than optimal, leading 
to less^J^i(^rship” and accountability. According to its CEO, 
HARTHjres third-party consultants to fill management and staff 

f ^*^ns rather than City employees because it is unable to find 
y qualified candidates willing to accept a City salary for the 
ions. In addition, since the construction of the rail system has a 
finite duration, it is the CEO’s contention that HART will eventually 
“work its way out of business,” and he does not want HART to be in a 
position where it will have to terminate civil service employees at the 
conclusion of the Project. 

While we recognize the CEO’s concerns as to the eventual shuttering 
of HART operations, the rail has a long way to go before it reaches 
Ala Moana Center. 


does not 

lerform actual design, 
ering, construction, 

, ufacturing, maintenance, and 
^servicing functions internally, it 
relies on its Quality Assurance and 
Quality Control division to monitor, 
“■ oversee, and audit all contractors, 

consultants, and suppliers to 
assure that their respective 
quality assurance programs are 
being effectively implemented. 
HART has contracted these 
services out to HDR, its project 
management support consultant. 
The division’s auditors conduct 
quality assurance audits using 
checklists based on the respective 
contract requirements and quality 
assurance plans. 


We asked the Director of Quality 
Assurance and Quality Control, 
who is an employee of HDR, 
how he avoids the conflict of 
overseeing his audit staff’s 
review of HDR’s contractual 
responsibilities and his fellow 
HDR employees’ activities under 
that contract. He told us that the 
division does not audit the HDR 
contract, meaning that there is 
no quality assurance review to 
assess HDR’s compliance with 
its contractual responsibilities. 

The director said that, because 
HDR’s employees are embedded 
in the HART organization, HDR 
employees’ performance is 
assessed together with and as part 
of the annual quality assurance 
assessments that HART conducts 
of its sections and divisions. 
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Recommendations 


1 . 


Communication between HART and the Board of Directors 

HART should update its policies and procedures related to^t$*^ 
and the Board’s respective responsibilities to ensure th^^ltitters 
requiring the Board’s consideration and approval are presented to 
the Board. HART’s policies and procedures shoul^^sure that 
Board members are provided all necessary mat^^ls sufficiently 
in advance of the Board meeting to allow rtf^i^ers to thoroughly 


consider the materials. 




2 . 




.cr 








HART and the Board should consid^^^her clarifying their 
respective responsibilities by m(^«^^early defining the matters 
requiring board approval. F^Srample, HART and the Board’s 
policies and procedures slj^ltr clearly define the fiscal and other 
information that HART»^^|^ld include with its operating and 
capital budgets that al^^resented to the Board and when HART 
adds or eliminaU^imtract packages. Given the history of the 
Honolulu Rail mmsit Project, specifically, our finding in 
Report 1 th^^ART did not provide or delayed providing 
informat^pmbout project costs to the Board, HART and the 
Boar^jiould include much more specificity in describing and 
de^qjhg their respective roles and responsibilities. 

Board should update its policies and procedures to require 
HART to provide allocated contingency for each contract 
(or contract package), both executed and anticipated. 


4. If HART and the Board believe that the contract-specific 
allocated contingency should be withheld from the public and 
the Board should be able to consider the information in an 
executive session under Section 92-5(a), HRS, HART should 
consider proposing amendments to both the Sunshine Law, 
part I of Chapter 92, and the Uniform Information Practices Act 
(Modified), Chapter 92F, HRS, to allow it to privately consider 
and withhold the information from the public. 

5. The Board should reconsider whether it is appropriate to 
delegate its authority and responsibility to an Executive 
Committee, comprised of less than the entire Board, to make 
Board-required decisions and/or to provide guidance on behalf 
of the Board to the CEO. The Revised Charter of the City and 
County of Honolulu created a board of nine voting members to 
collectively oversee and guide HART. Members should not be 
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“disenfranchised” because the Board has struggled to convene a 
quorum. 


6. HART and the Board should consider annual training on the 
State’s public meetings law, known as the Sunshine Law, part I 
of Chapter 92, HRS, to ensure the public policy of opening up 
the Board’s decision-making processes to public scrutiny and 
participation. The training is more important and necessary 
given that, according to the Board Chairperson, the Board 
members are receiving more reports, including project updates, 
outside of noticed Board meetings. The annual training should 
be conducted by the Office of Information Practices, which is 
responsible for administering and enforcing the Sunshine Law 
and the State’s public records law, the Uniform Information 
Practices Act (Modified), Chapter 92F, HRS. 


.c 


7. The Board should consider creating a staff position that is 
hired by and reports directly to the Board. The position^’s 
responsibilities should include supporting and advisini^ 
Board, ensuring that the Board receives timely and t^nplete 
information necessary for the Board to perform<^^^ersight and 
management of HART as required by the Bo^^^policies and 
procedures. 

V 

HART Consultant Performance Evaluai^pns 

8. ALL CONSULTANTS: HART develop and implement 

policies and procedures for a™^ performance evaluations of 
its third-party consultants, in^ding action plans to ensure that 
deficiencies are addre^b^«(fid corrected. 

9. ALL CONSULTA^^: HART should provide its annual 
performance wammions of its third-party consultants, 
including t^^^l^on plans, to the Board for its information and 
consider; 


10. H 




wen HDR’s role as embedded HART employees, 
management should work with HDR to develop specific 
iFformance metrics in addition to HDR’s own evaluations. 


. HDR: HART should require HDR to annually evaluate the HDR 
employees who are embedded into the HART organization based 
on the agreed-upon performance metrics and require that HDR 
provide HART with copies of those evaluations. 


12. HDR: HART should independently evaluate the performance 
of the HDR employees who are embedded in the HART 
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organization and who report directly to the HART CEO and/or 
other HART staff. 


13. HDR: HART should transition key management positions from 
third-party consultants to HART employees, as recommended 
by the FTA in its 2014, 2016, and 2018 Risk Refresh reports, imj^ 
order for HART to “have more ownership and maintain stroH^jir 
continuing control of the project.” 




HDR Invoice Review 






.cr 








14. HART should establish procedures to review invoices 
on a regular basis to verify that charges are4^^imnensurate 
with work performed; the procedures sho^ include required 
documentation to support the appro’raj^the invoices, or 
portions thereof, for payment. 

15. HART should ensure that, aL»W^mum, HDR employee work 
summaries are assessed fgi;re«sonableness and appropriateness 
by someone with suffic^^^xperience and substantive 
knowledge in the area^the employee’s work - and who is also 
not an employee^^iOR. 

16. HART shoul^pnsider retaining a third-party organization with 
experience"^major government construction projects to review, 
assess a^^fmake recommendations regarding HDR’s invoices to 
eng(nffl>^ompliance with contractual terms, the appropriateness 

work, and the reasonableness of the amount of time 
Npcurred to perform the work. Although the CEO said that 
he didn’t believe that the cost of a third-party organization to 
review HDR’s invoices outweighed the possible saving, we note 
that the HDR contract costs HART $9.6 million per year for 19 
embedded HDR employees. 


HART Quality Assurance 

17. HART should review its policies and procedures regarding 
its quality assurance audits to ensure auditors appropriately 
document their audit work, including ensuring that 
documentation is legible and complete. 

18. HART should develop policies and procedures to organize, 
retain, and secure quality assurance audit records to ensure that 
those records are readily available for internal inspection and 
review. 


19. HART should retain complete documentary evidence of its 
quality assurance audits of its consultants, to provide an “audit 
trail” supporting its findings and conclusion. 
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Office of the Auditor’s Comments 
on the Honoiulu Authority for 
Rapid Transportation’s Response 
to the Audit Report 



W E PROVIDED A DRAFT OF THIS REPORT to the Honolulu 
Authority for Rapid Transportation (HART) and discussed 
the report at an exit conference attended by the Chairperson ^ 
and Vice Chairperson of HART’s Board of Directors as welin^ 
as the Chief Executive Officer, the First Deputy Executive Director, thjQ^ 
Chief Financial Officer, and the Deputy Executive Director of Gojtdl^lent 
Relations. HART provided a written response to the draft report, waich is 
included in its entirety as Attachment 1Ov 

HART states that the intent of its response is to “clarifwl0tRT’s current or 
future actions” related to our audit findings. Howev^^^e believe certain 
statements warrant co mm ent for further clarity ^perspective. 

HART noted one factual error in the repoi^e^rding HART’s budget 
transmittals to the Honolulu City CounoCTv^e have revised the report 
to correct the inaccuracy, which is pa^>ofthe factual background. The 
revision, however, does not alter ouNiudit findings. 

X'V 

In numbered section 2 of its^isponse, HART attempts to minimize the 
difficulties that we encqu^irafed in accessing information necessary to 
perform our audit wo^.^We disagree with HART’s characterization of 
the difficulties we^^R^ simply a difference of “expectations.” In our 
comments to HifflHTs response to our first report. Report No. 19-03, 

Audit of the H'^wlulu Authority for Rapid Transportation: Report 1, we 
detailed s|^^5v&f the challenges that we confronted in obtaining information 
and de^obBed other information we requested from HART but never 
rec^^a or received only after months of delay. Because HART’s response 
i^ll^bered section 2 is substantively identical to its response to the earlier 
,^^port, our comments attached to that report are equally applicable here. 
y We refer the reader to the Office of the Auditor’s Comments on the Honolulu 
Authority for Rapid Transportation s Response to the Audit Report which 
starts on page 33 of Report No. 19-03. 






' HART provided a written response to the draft report on January 4, 2019, and a second 
response on January 7, 2019. The second response states that it “includes input from HART 
staff and some of the HART Board Members,” and the email transmitting the second 
response says that it “supersede[s]” the earlier response. 
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In numbered section 6 of its response, HART addresses our finding that 
HART withholds from the Board the amount of allocated contingency 
associated with its contracts, both those awarded and anticipated. As 
explained in the report, the allocated contingency is the “cushion” or 
“reserve” that is part of a contract’s budget to cover unforeseen costs. 
According to HART, it considers contract-specific allocated contingeri^ * 
to be “confidential.” HART believes that disclosure of the informartiM 
“removes important leverage when negotiating with contractoi;s(^^ating 
“HART has a responsibility to the taxpayers to manage the project in a 
fiscally sound manner." 




.cr 




We strongly agree that HART must be fiscally resp^^^Jble in its use of 
public funds. However, we disagree that keepin^ecret the total amount 
it has budgeted for specific work - i.e., the cq^iact-specific allocated 
contingency - is consistent with that respm@|o1^1ity. In fact, the history 
of the Honolulu Rail Transit Project, snflS&ally the significant 
increases to the Project’s estimated ^^t^elies HART’s suggestion 
that withholding the contract-spe^callocated contingency benefits 
taxpayers or otherwise improvi e0ts fiscal management of the Project. 
Withholding financial infoi^^^on from the Board, the lawmakers, 
and the public seems to^MVi^nly allowed HART to evade necessary 
oversight. ^ 

As we report in/g^ort No. 19-03, Audit of the Honolulu Authority 
for Rapid T^^portation: Report 1, through much of 2015 and into 
2016, H^^reported estimated project costs to the Board that were 
well-l|i^aj>v its internal projections, obscuring the financial realities 
and the need for additional funding to complete the Project. And, it is 
^psOTse of hart’s poor fiscal management of the Project that contract 
•^igmicitations for stations and the city center section of the guideway had 
to be cancelled and the opening date has been delayed to 2026. 


As we explain in the report, HART has procedures, namely its Contract 
Change Procedure, that are intended to protect against contractors taking 
advantage of HART by requiring HART to determine “merit” before 
it agrees to additional compensation. If that process is insufficient to 
adequately protect public funds from being misspent, HART should 
develop a more robust process, not hide financial information from the 
Board or the public. 

We also feel that HART dismisses our concern that, without the 
contract-specific allocated contingency, the Board does not have 
sufficient information about the total budget for a contract and, 
therefore, does not know when HART exceeds the budget. Without that 
information, we question how the Board can hold the CEO accountable 
for hart’s financial management, which is arguably the Board’s most 
important responsibility; we question how the Board can determine 
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whether HART’s budgeting proeess, ineluding alloeation of risk, is 
sufifieient; we question how the Board ean represent that the Projeet 
is on-budget if the Board is unaware whether eurrent eontraets have 
exeeeded the budget for the particular scope of work. 


In numbered section 9 of its response, HART appears to minimize the 
risks posed by lax consultant oversight by reasoning that “failure, in 
the consultant world, is expensive both monetarily and reputationally” 
and that “[n]o consulting firm wants to fail.” This comment paints 
an incomplete picture - failure is not the only motivating principle 
that exists in the consulting industry. An equally evident motivating 
principle is the desire to maximize profit. HART’s acknowledgement 
that “improvements should continue to be made to Consultant 
oversight,” and its agreement with our finding that its review of HDR 
monthly invoice justifications is insufficient, underscores the importan^^ 


of stricter oversight of consultants on the Project - all of whom are 
motivated by more than just a desire to avoid failure. 

numbered section .4 of iis response, HART states that 
[consultant audit checklists] shown (inspection, measuri^^J^sting 
equipment) is not relevant” to CH2M Hill, PGH Wong^M Stantec. 
First, as HART notes in its own response, the refereno^ images 
were meant as examples. During our fieldwork,^^also came across 
CH2M Hill checklists that were incomplete qi^Jientained illegible 
notations. Second, the images we reprod^^ in the report are unaltered 
scans of the consultant audit checklist ♦ns3 Stantec and PGH Wong, 
HART’s Construction Engineering jsmdJnspection Consultants (CE&I). 
As can be seen in the images, many Mecklist items directly reference 
Stantec and PGH Wong: verify that calibration 

is traceable to the Nationa^istitute of Standards and Technology 
(NIST) or manufactureiN;^ommendations?” “Does the CE&I verify 
that records of equipratot issuance and calibration are properly kept 
and maintained?TV^reover, there are notations in the “Compliance” 
column of th^CpI^list and we maintain that these are relevant. 

In nurnjj^^^^ction 15 of its response, HART asserts that our statement 
“the buli^ll too often stops at a consultant” is incorrect and that, 
‘^N^ality, the CEO and the Board have ultimate ownership of project 
i'Te^finsibility.” HART misunderstands our audit findings. In our report, 
Swe acknowledge that the Board is the policy-making body of HART 
and that the CEO, who is responsible for the entire HART organization, 
is directly accountable to the Board. But, the “reality” is as we 
describe in our findings and as HART describes in its own response 
- specifically, HART’s agreement that “performance oversight and 
evaluation needs to be strengthened” (Response Page 7); that reviews 
of HDR’s monthly invoice justifications are insufficient (Page 11); 
and that Quality Assurance/Quality Control needs to be evaluated to 



Report on HART’S Management Structure, Decision-Making Processes, and Use of Third-Party Consultants 
in Key Management Positions 


identify areas of improvement (Page 14). While the Board and CEO are 
vested with responsibility under the City Charter, our findings support 
the conclusion that “the buck” does not always stop with HART when 
HART lacks sufficient oversight of consultants embedded into key h 

positions of the organization. 

In numbered section 15 of its response, HART states that “[t]he 
Management Oversight Consultant (PMOC) hired by the FTA^^y 
oversee the project has acknowledged that reliance on consulta«s in 
a project of this complexity is a common practice.” We h^i^’C'e this 
statement is misleading. We acknowledge in our repo^^^m HART’s 
use of consultants may be a concession to certain a^^stional realities. 
Coupled with the obvious profit motive of consit^nts, HART is not 
absolved of its responsibility to adequately oye^ee those consultants 
and to take greater responsibility and own^^^ of the Project. In fact, 
the same PMOC that HART identifies ijpJ^response has repeatedly 
stated since as early as 2014 that H^^^should transition key 
management positions from constants to City employees “in order to 
have more ownership and man continuing control of the project.” 

<>• 
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lao.auditors@hawaii.gov 

Mr. Leslie H. Kondo, State Auditor 
Office of the Auditor 
State of Hawaii 

465 South King Street, Room 500 
Honolulu, Hawaii 96813-2917 

Dear Mr. Kondo: 


Krishniah l^^^hthy 
SENJO^^DVISOR 

DIF 


3 ' 


-DIRECTORS 












Very truly yoL 




. Robbins 
itive Director and CEO 



Subject: Audit of the Honolulu Authority for Rapid Tfa^portation (HART) - Part 2 

Enclosed is HART’S Response dated January 7,^»19, which includes comments from 
the HART Board of Directors, to the Draft Ay^^Report Part 2 entitled “The Buck 
Stops...Where? Report on HART'S Managel\^nt Structure, Decision-Making 
Processes, and Use of Third-Party Cons^|B*nts in Key Management Positions” 
received on December 21, 2018. include these comments when you issue 

your Final Report. HART looks torj^d to receiving your recommendations 
associated with this report aitunsiDbviding comments, if any, as we have been able to 
do with your draft audit reoort.^ 

Should you have anydi^tions on our Response, please feel free to contact me 
directly. 


Damien T.K, Kim 
CHAIR 

Terrence M. Lee 
VICE CHAIR 

Jade Butay 
John Henry Felix 
Wes Frysztacki 
Kamani Kuala'au 
Wesley K. Machida 
Tobias Martyn 
Glenn M. Nohara 
Ember Shinn 
Kathy Sokugawa 
Hoyt H. Zia 


CITY AND COUNTY OF HONOLULU. Alii Place. Suite 1700, 1099 Alakea Street, Honolulu, Hawaii 96813 
Phone: (808)768-6159 Fax: (808)768-5110 www.honolulutransit.org 
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HART acknowledges the receipt of the Draft Audit Report Part 2 - Management of HART pursuant to Act 
1, First Special Session 2017 in a document dated December 20, 2018. HART welcomes the State's 
constructive, vigorous and healthy oversight and will strive its best to incorporate suggested 
recommendations within the constraints established by its Board and their policies. We are consistent 
in our approach to all federal and local oversight, reviews, and audits. This response includes input from/TiN 






HART staff and some of the HART Board Members. It is intended to clarify HART's current or future 
actions related to each issue. 






This response document is laid out in multiple parts. Section 1 is an overview of the Audit ReoC^cope 
and findings. Section 2 is a response to statements in the Audit Report. 


A 

vmkir 


Section 1. Audit Report Scope and Findings 

The Buck Stops ... Where? Report on HART's Management Structure, Decisifjn^^king Processes, 

and Use of Third-Party Consultants in Key Management Position (Part 2) 

The objectives of Audit Report Part 2, focusing on the period FY2016-.i; ere described by the State 

1. Describe the current condition of HART's administratjof^rrcl operations. 

2. Assess whether HART's oversight and managememj^itfsfelected consultants is in compliance with 
applicable laws, policies, procedures, and other rele^nt best practices. 

3. Make recommendations as appropriate. 

After detailed reading of the report, HART belj^sps^^iere are two key findings that the State Auditor is 

conveying with this document. Within this r^^jbnse, we will address the components of these findings: 

• HART's decision-making proce^^^n particular the interaction and division of responsibilities 
between HART's Executive^irector-Chief Executive Officer (CEO) and the Board, have changed 
over time and remain nM^eHted at the time the Audit was performed. 

• HART uses third-part^^nsultants rather than HART employees for several key management 
positions, and HAfQ^ oversight of these consultants is not well-documented and does not 
adequately en^^ performance and accountability. 

HART's responseS^^^ese findings are in Section 2 below. 

Sectioo^^v^sponses to Statements Made in the Audit Report 

Scope & Methodology (Page 3) 


^e^dit focused on FY2017-2018. Auditors conducted interviews with HART management, staff, the 
✓"i^rd chair, and certain consultant contractors. HART questions if the Auditors also took the 
,^^pportunity to interview past Board Members and past Board Chairs for a wider picture of past 
activities. 
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2. Difficulties with access to information (Pages 3-4) 

While carrying out their mandate of designing and 
constructing a rail system, HART staff worked with 
the Auditors to accommodate their requests. 

HART believes that it was cooperative although it 
is acknowledged that timeliness of response was 
an issue and is an area of improvement in the 
future. Regrettably, HART's overall efforts fell 
short of the Auditor's expectations. However, this 
was not because of a deliberate refusal to provide 
the full cooperation pledged to the Auditor by the 
Board and HART. 


While carrying out their mandate of 
designing and constructing a rail 
system, HART staff worked with the 
Auditors to accommodate their 
requests, although it is achtiowledged 
that timeliness of responses was an 
issue. ^ 








to 


During the Audit process, the Audit Team had access to over 
1,600 electronic files consisting of 36,400 pages to the audit 
teams. These files included 472 emails, over 5,000 pages of E 
data, 350 pages in Word, and over 30,000 PDF pages. HAR 
provided numerous hard copy documents for the audit^ 
review, in addition to the electronic documents. 

Colocation /CS* 

.y 

Auditors and their consultants were provid^)Dffice space and a 
computer with internet access withirvwOlART offices from 
inception of audit to December 2(^^(wd of audit). 

Interviews 


:s 








HART participated in ov,i 
to follow-up discussij 


... _.,^(^^nt6 
5siJte«i 

y^tinq I 


interviews with 23 staff, in addition 
d impromptu questions. 


HART provided access to: 
over 1,600 electronic 
files consisting of 
36,400 pages 
including: 

472 emails 

5,000 pages of Excel 

data 

350 pages in Word 
30,000 PDF pages 
35 interviews with 23 
staff 


Executive Sessi 'ting Minutes 

HART pro\Mj^5he publicly available Board meeting minutes as HART provided the publicly available 
Board minutes as requested by the auditors. With respect to the non-disclosure of Board 

Exefttfi^^ession minutes, legal impediments posed a challenging dilemma to the Board in preserving 
rney-client privilege and honoring certain contractual and legal obligations of confidentiality and 






acy. 

CMS 

The HART CMS Support Team was tasked to provide access to all auditors from DAGS, State Office of the 
Auditor and consultants. City and County of Honolulu Auditors, and FTA. While every effort was made to 
provide full access to the system, we encountered unknown technology barriers; this was a great 
frustration to the CMS Support Team, HART management and to auditors. The issues experienced were 
technical (IT) in nature and affected both HART staff and auditors alike. Electronic access to HART's 
records is imperfect due to difficulties with the non-supported Oracle Contract Management System. 
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HART is taking action in this area in eariy 2019 to heip correct these 
issues. There was no intent to keep the auditors from accessing 
fiies. 

Conclusion 

Despite the difficuities mentioned above as weii as shortcomings in 
the timeiiness of cooperation, the Auditor conciuded that they 
beiieve the evidence obtained by them was sufficient and 
appropriate to support their findings and conciusions made in the 
report. 


3. Background (Page 5) 

The Audit Reports assert that the GET and TAT can oniy be used for 
"capitai costs" characterized as "expenses directiy reiated to 
construction of iand acquisition for the Project." HART wouid iike.i 
ciarify that HRS §46-16.8 specificaiiy inciudes in the definition i 
"capitai costs," for counties with a popuiation greater thai^^tVcfOO 


"non-recurring personai services and other overhead costsNtiat are 
not intended to continue after compietion of construe(JJvf of the 
minimum operabie segment of the iocaiiy preferred ^ernative for 
the mass transit project." This was not repeaipfiCbVAct 1 and 
remains the statutory definition of "capitai \ 


Despite the 
difficulties 
mentioned above as 
well as 

shortcomings in t 
timeliness of ■ 
cooperation, 

Auditor ccncluded 
that th?y believe 
the evidence 
U?:^*>^ined by them 
was sufficient and 
appropriate to 
support their 
findings and 
conclusions in the 
report. 






5 ^ 


4. Federal Oversight call 




(Page 7) 


The Federal Oversight call-i X reports on the FTA activities and interaction with HART during the 
audit period, through Sei^^^ber 2018 only. The latest Revised Recovery Plan was approved by the 
Board, reviewed by tlw^y Council, and submitted to 

FTA on Novemb^ fejOlR. Subsequently, FTA sent _ 


vemPe^w^ 

HART a positiv^e^r on December 7, 2018, 
lin^tne 


acknowledsjn^tne Revised Recovery Plan and the 
steps laken to align the project with the FTA 

requesKTThe audit should show the full picture of all 
ip^t^ctions with the FTA; as such, HART recommends 
the call-out box be amended to discuss the 
^vjsubmittal and acknowledgment of the Revised 
Recovery Plan. 

5. HART and Board policies delineating decision-making responsibility are still in flux (Page 10) / 
Board's increased oversight authority yet to be implemented (Page 11) 


By its approval of Board 
Resolution No. 2018-14 on 
November 15, 2018, the Board 
adopted new Board rules 
implementing the Board's 
enhanced oversight authority. 
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As noted in the Audit Report, foiiowing the passage of Charter Amendment 4 in 2016, the Board 
carefuiiy considered how to impiement their enhanced oversight authority and draft corresponding 
ruies. Board Resoiution No. 2018-14 on November 15, 2018 adopted the ruies, impiementing the 
changes. It is important to note that the decision-making responsibiiity was being deveioped during 
course of the audit, further, finaiized foiiowing the fieidwork compietion of the audit. Based on 
Resoiution No. 2018-14, internai poiicies and procedures reiated to Board communications and 
decision-making wiii be updated during 2019. 

Transparency and communication is continuaiiy increasing between HART staff and the.^^d, as noted 
in the Audit Report. Given that the Board meets once per month, it remains vitai CEO, in his roie 

as the Chief Procurement Officer, has the abiiity to make timeiy decisions reiat^^Ji administrative. 








procurement, and design issues. 






6. Gray Areas may persist (Page 12) / HART withholds conti y amounts from budget 
reporting (Page 13) 'X 

HART discloses total, or a lump sum, contingency for 
the Project but considers individual contract 
contingencies as confidential. Disclosure of this 


HART has a responsibility to the 
taxpayers to manage the project in 
a fiscally sound manner. 


information removes important leverage when ^ 
negotiating with contractors on claims settlema^, 
change orders, and contract close out. HAR^^s a 
responsibility to the taxpayers to mansgjsjhe project 
in a fiscally sound manner. It is conwtOTrpractice 

amongst major US transit and prfcj^ef-specific agencies to operate in this manner, which we understand 
is different than how the State operates. 

The U.S. Department of'^^sportation's guidance on Financial Plans Contingency Fund Management for 
Major Projects recMhSifts that financial plans should provide current project information to enable 
government agejncie^nd "the public" to evaluate the fiscal health of a project and that contingencies 
can be identigeov^a separate line for each "major element" for a project. HART's financial plan is 
organized feyjtdjor elements, including construction and design. 


Accoi^iriV^ HART understands the need, and desire, for 
tr^Wb^ncy in project costs, including contingencies. To address 
N^i^inding, during the first half of 2019, HART will consider revising 
its financial reporting to separate contingencies by major elements. 


In 2019, HART will 
consider revising its 
financial reporting to 
separate 
contingencies by 
major elements. 


It should be noted that the Permitted Interaction Group of the Board 
of Directors that engaged in revising the Board's rules and 
procedures had much discussion amongst its members and HART 
staff on the matter of whether to disclose contract contingencies to 
the Board. For the foregoing reasons, the Permitted Interaction 
Group ultimately decided to rely on its oversight via its Project 

Oversight Committee. One or two members of the committee regularly participate in the Project 
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Management Oversight Contractor meetings with HART staff, at which contract contingencies are 
discussed. See aiso the discussion of contingency in Item 8 below. 




Also within this section, at the bottom of page 13, the Audit Report states that the City Council is "asked 
to-and does-approve HART s construction budget and that the approval authorizes HART to expend 
funds for those purposes." This is not correct. HART's budget transmittals to the City Council do not asl^^ 
for approval. 




7 . Gray Areas may persist (Page 12) / Decision to 
pursue P3 to complete construction left to the 
discretion of the CEO (Page 14) 

The selection of method of procurement is within the CEO's 
(who is also the Chief Procurement Officer) purview in 
accordance with the Hawaii Public Procurement Code. The 
CEO is accountable to the Board of Directors and using his 
professional and engineering judgment, developed over , 

decades in the industry, identifies key and relevant issues to 
bring before the Board, the City, and all other appropriate 
stakeholders. 






XV 


The method of p^^urement 
is within the CK-Vs authority 
and discretion as prescribed 
by the H j.vaii Public 
Procurament Code, as the 
Citiof Procurement Officer 
■^idr HART. 


L Tne 


id'deliv 


of the project. City Center Guideway and Static^T^ Trie consulting firm Ernst & Young Infrastructure 
Advisors EEC conducted the detailed feasibi|j^^nalysis for delivering the final portions of the project on- 
time and on-budget, which supported thQs’delivery methodology. This analysis was supported by 


Within the Audit Report, the 
Auditor acknowledges that the 
CEO took appropriate action 
even while having authority as 
CPO over the method of 
procurement. It should also be 
noted that the Board of 
Directors believed in final 
deliberation that it had 
authority over the P3 delivery 
method and therefore took 
appropriate action. 


industry and stakeholder input through an Industry 
Forum and a Stakeholder's Forum>iffhC/feport findings and 
stakeholder inputs were report^oSo the Board. The 
study and industry outreach^^ults led to the 
procurement of a P3 legal aro financial consultant and 
the currently-in-progrg^/flART-City joint procurement for 
a P3 consortium. Ojutrfg every step of the process, the 
findings were »^d with the Board and the City. The 
decision t^m^tain this transparency was made early on 
becau^TptVfe significance of utilizing a project delivery 
ne\ 4 (^ rKis Project to ensure that all stakeholders 

Stood the risks and potential benefits of pursuing a 



The CEO, as Chief Procurement Officer, will continue to 
keep the Board and the City abreast and involved in key 
^ procurement decisions. In the case of the P3, it was 

approved by the Board and supported by the Mayor of 
Honolulu and the Honolulu City Council in a Resolution. 
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Within the Audit Report, the Auditor acknowiedges that the CEO took appropriate action even whiie 
having authority as CPO over the method of procurement. It shouid aiso be noted that the Board of 
Directors beiieved in finai deiiberation that it had authority over the P3 deiivery method and therefore 
took appropriate action. The Board s new ruies, adopted in November 2018, memonaiizes the Board;^^ 
beiief that decisions such as project deiivery method, which affect budget and scheduie, faii squ^q+jN 
within the Board's authority. j 






8. The Budgeted Contingency: expecting the unexpected (Page 14) 

Contingency exists in order to prepare for the unknown, inciuding differing site c^j^itions, such as 
unknown underground utiiities. As projects achieve higher ieveis of compietiafQjhe amount of 
contingency necessary drops. Contingency is deveioped based on FTA guidaiwes, good engineering 
judgement based on prior experience, and continued risk assessment f<5^ch contract. 

Previousiy, the Board reviewed for approvai individuai change ofder*4n excess of $1 miiiion, but on 
November 15, 2018, the HART Board of Directors adopted ne\^ 5 Mlfes and procedures regarding reviews 
of change orders and added oversight on the pianning, cop^^raon, and deveiopment of the raii 
project. 

In particular, the Board will put forth a greater focus o«.how "expenditures and use of contingency 
funds are expended within the Board approvecW^^ncial Plan and FTA approved recovery plan for the 
HRTP" to include, amongst other things, the^^^oval of any use of unallocated contingency regardless 
of dollar amount, and activities that affefVhe scope, schedule and Financial Plan. 

HART also took steps to improve ite^^ion-making process by developing an Executive Decision 
Document (EDD) procedure whic^t^^urrently in review by executive management of HART for approval. 
This process ensures "key" ^^^r significant decisions are made with proper input, review, and 
documentation from all^»^^^nt divisions within HART prior to the approval by the Executive Director. 
The EDD is required fORk^ decisions, including significant changes to contracts. 

9. HAET^ies on Third Party Consultants to Oversee and Manage Other Third-Party Consultants 


^^sl5,17) 

HAeO^/ project-specific agency, unlike any other in the State of Hawaii. As the Audit Report states on 
"Therefore, HART now has an expiration date; once the rail system is operating, HART's mission 
j/vitl end." And on page 17 of the Audit Report, "HART hires third-party consultants to fill HART 
management and staff positions rather than City employees because it is unable to find highly qualified 
candidates willing to accept a City salary for the positions. The flexibility to attract and hire appropriately 
qualified applicants is also the reason why HART stopped hiring civil service employees in 2016." 
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As such, HART utilizes embedded or "seconded" consultants to bring unique capabilities to the 
organization for the finite duration of the project. Including seconded, expert staff to supplement a pool 
of City employees is common in the industry and especially for limited-term mega-project development. 
For example, the use of expert, seconded staff is commonly used for rail projects in Asia which 
traditionally had not had a history of such project development and where local skill sets had not yet 
been developed. Utah Transit Authority and Los Angeles Metro Construction Authorities also operate 
this manner. Given Hawaii's remote geographic location, this project being the first rail transit pro^h^iin 






5 ^ 


the State, and the relatively short-term need for a full complement of professionals with specif 
design and construction expertise, its situation is quite similar to those in Asia - and there^ 
staffing solution is also quite similar to that in Asia. ^ 

The ratio of HART employees to program management support consultant staff is (as of 

December 2018). The HART CEO views this as a balancing act in terms of obtainin^i^ necessary 
expertise provided by seconded staff and the stability of City staff. HART will «Jminue to replace 
seconded staff with City staff wherever possible, but the needs of the prqd^^Snust be considered. 

Seconded staff by their very nature are embedded in the 
overall HART organization - so in this way personnel are 
accountable to their supervisor as with any organization. 

In some cases, consultant staff seconded to HART ^ 

supervise other consultants. However, all consultant ^ 
staff are aware that ultimately, HART is the client and"^ 
the project is the goal. To not meet the tenets of tH(^* 
contract, the needs of the client, or the goal s4J))e 
project is to fail. And failure, in the consuLt^rworld, is 
expensive both monetarily and reputatji^nsj)/. No 
consulting firm wants to fail. 



tlART utilizes embedded or 
"seconded" consultants to bring 
unique capabilities to the 
organization for the finite 
duration of the project. 
Including seconded, expert staff 
to supplement a pool of City 
employees, is common in the 
industry and especially for 
limited-term mega-project 
development. 


x'V 

HART does agree that performa^^oversight and 
evaluation needs to be strer>™ened. - in the case of 
seconded staff - this is antiSpated to be via 
performance evalualten^rlftcally as well as by the 
consultant (HDR) ti<|£g«elves. HART is developing 
additional pro^ef^es, outlined in the responses below, 

in order to/e^^jjj^s both the personal performance reporting and the consultant firm performance 
report i^^^4^ectively. 

Lo^i?te forward, as HART recognizes the need to transition away from seconded consultants to local 

it is proactively partnering with the University of Hawaii Leeward Community College to develop 
^ghly skilled and high wage earning electrical and mechanical technicians to work on the rail transit 
project operations and maintenance activities. The Integrated Industrial Technology Program at LCC 
provides an opportunity for workforce development where its graduates are trained to program, 
operate, maintain, calibrate and repair equipment that make up the rail system. Filling these jobs will 
be vital for the lifecycle success of the project. 
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To this end, HART has started a deveiopment with Waipahu High Schooi, which is situated next to the 
Raii Operations Center, to stimuiate interest from the Academy of Engineering students to pursue a 
career in raii transit. iON * 




ej 




he decision to deliver a project 
through any method is never 
one to be taken lightly, and the 
steps taken by HART to analyze 
options, build consensus, and 
achieve an outcome have been 
more than adequate. 


10. To P3 or not to P3? HART's midstream pivot to a P3 project delivery model raises more, 
questions than answers - Call out box (Page 16) 

HART is tasked with the deiivery of the project within a certain scheduie and budg^H^I^^Jier the 
founding documents nor subsequent iegisiation dictate the method in which the pro-am is deiivered; 
that is ieft to the expertise of HART ieadership and the Board of Directors. As suc^^hen it became 
apparent that in order to meet our commitment to the FTA and to the taxpay^pof Honoiuiu something 
wouid need to change, the HART Team did what many other agencies havaabne in simiiar situations: 
they thought out of the box. They brought in experts on giobai best pr^^es, studied deiivery options 
for over a year, and made the sound decision to 
deiiverthe iast phase of the project in a manner 
which wiii best achieve the program objectives. This 
work was performed transparentiy throughout the ^ 
anaiysis, with reguiar Board briefings, an Industry 
Forum, a Stakeholder's Forum, presentations to 
business and labor groups, and involvement b^>^* 
various City departments and the City Couru^jjtefer 
to Council Resolution 18-139, CDl, FDl|^hMecision 
to deliver a project through any metK^^Ts never one 
to be taken lightly, and the steps by HART to 
analyze options, build consensus^nd achieve an 
outcome have been moi^lHi^ljj/edequate. 

Regarding the last p^wMgpn in the call-out box, HART would like to point out that fare revenue is not 
sufficient to cover in any lifecycle analysis, as such, it would not be sufficient to compensate the 
P3 entity for 08^^ The City's farebox policy assumes the City pays about 70% of the operating costs. 
Finally, revei(^)^k within a transit P3 is very uncommon and would likely result in fewer bidders and 
higher address this risk. 

V^l. HART oversight: reactive and after the fact (Pages 21-23) 

As an organization, HART has historically had a number of consultant staff seconded to the HART 
organization, and without consulting an organization chart, it is often difficult to identify who is staff 
versus consultant. As a matrix organization, reporting relationships occur by discipline and across staff 
classifications. HART agrees that this has made oversight difficult in the past, but has made recent 
efforts to increase transparency and improve the interface between consultants and staff. 

As stated in the response previously, HART is not dissimilar to other single-purpose agencies in the US 
and abroad, where project leadership staff are a blend of employees and consultants. Refer to Item 9. 
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HART agrees that improvements shouid continue to be made to Consuitant oversight. To address this, 
HART has initiated a formai procedure for the review and approvai of staff performance reports. 
Specificaiiy, HART wiii require that the supervising personnei of aii seconded consuitant staff review and 
approve the performance report; that appropriate 


work was performed by the personnei under 
his/her supervision. If the supervising personnei 
is a consuitant from the same consuiting firm, the 
supervising personnei's review wiii be reviewed 
and approved by a HART personnei. This new 
process wiii be memoriaiized in a formai 
procedure. In integrated offices where 
consuitants and owners are co-iocated 
accompiishments of specific objectives becomes a 
common goai with a coiiaborative effort. 

Nevertheiess, HART cieariy understands the 
responsibiiity of overseeing consuitants and 
ensuring their performance for which they are 
engaged. 

When the interim CEO took over his duties as CEO and Exe 


HART has initiated a formal procedure 
for the review and approval of staff 
performance reports. Specificall 
HART will require that the supervising 
personnel of all seconded.consultant 
staff review and approv^^^e 
performance report- th;Ta^ppropriate 
work was perforrricH by the personnel 
under his/her supervision. 








Director, the HART organization was 


under intense scrutiny and was faced with questions ajflsprning its management capacity, technicai 
capacity, abiiity to forecast cost to compiete, and a^i^ to forecast compietion dates. Having previousiy 
been in management of mega projects such as/HAR^his first acts were to make sure that a reaiistic cost 
estimate to compiete the project was deveidGe^nd a master scheduie to compiete the project was 
finaiized so that he couid commit the org^rf^ation for compietion of this project in his testimonies to 
Honoiuiu City Councii, and State Legisia^Sre. This was a needed exercise to assure the decision makers 
that this project has an end date ai^^otai cost to accompiish that effort. 


Upon review of the perform 
changes were needed to btii 





of staff and consuitants, he advised the Board that some actions and 
ore transparency and accountabiiity by staff and consuitants. As a 


resuit of that review, h^ecided to remind the consuitants that they must recognize their commitments 
Jrtl^fiii ■ 




to the organization lifiii their scope of work in an effective and acceptabie manner. Letters were 
written to the ^n'OTfrants for their own independent evaiuation of their staff and work, and to aiiow 
them to proDos^Jfieir intended actions. The consuitants, as to be expected, came back with return 
response^el^ding their past and current performances. Severai one-on-one meetings were heid to 
discus ietters and proposed actions. It was at that time that the permanent CEO came on board. 
Afl^rViternai briefings, the CEO wanted to meet with the consuitants and have his discussions 
^hc^ning this issue. Whiie it was important to officiaiiy notify the consuitants that their performance 
^^eeded improvement, for contractuai reasons, it was feit that reguiar one-on-one meetings be heid with 
the management of the consuitant firms. This wouid aiiow needed improvements and/or changes to be 
impiemented and monitored. The CEO estabiished ^ new practice o| reguiar meetings with HDR 
executives where aii issues were discussed. Simiiar meetings were heid with executives of CH2M Hiii 
(now, Jacobs), PGH Wong, Stantec, and Lea & Eiiiott. As a resuit of these meetings, as weii as in-house 
senior staff meetings, many changes have been impiemented which have contributed to hoiding the 
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cost of the project at $8,165 billion dollars and holding the revenue service date to December 2025. 

Significant changes have been made in the areas of estimating, scheduling, change order processing, as 
well as giving responsibility to front line CE & I managers to oversee and make decisions. * 








12. HART does not review third-party project management support consultants' monthly invoice 
Justifications on a regular basis, relying on the consultant to determine whether ils^Mn staff's 


work is satisfactory (Page 24) 






Pursuant to a competitive solicitation, HART awarded and negotiated a contract fo^^i^ram 
management support consultant (PMSC) with HDR Engineering, Inc. (HDR), corar^]pcing January 1, 
2017. - 


. 6 ^ 


The current First Deputy Executive Director, then the Director of Procuj£^nt and Contracts, 
determined when entering into the HDR contract dated January l,^^(H^^at there was insufficient 
accountability, an insufficient documentation of day-to-day services^jrovided by the PMSC. As such, 
the Deputy Executive Director made several changes: (1) a tram^ of the project manager duties to 
Procurement and Contracts; (2) included a contract requir^^nt for each seconded PMSC staff member 
to provide daily work summaries; and (3) the inclusionW^^press contract requirement that the PMSC's 
"primary and overarching task is to oversee the sucd^vul design and construction of the full Honolulu 
Rail Transit Project." 




1 


The PMSC contract is a "seconded personn^j^ontract ("PM[S]C staff will be co-located with HART in 
the Project space provided by HART ancj^conded into HART positions in the overall organizational 
structure," Exhibit 1 of the PMSC Cor^^^. That is, each approved seconded PMSC personnel, is a 
professional staff under HART's cn^Q^iJational structure; this means that each PMSC approved key 
personnel embedded into HART's organizational chart reports to work every day (as a City employee 
would) a minimum 8.0 w^N^s/iours a day, except when they are on approved leave. As extended 
professional staff under^^T's organization, each personnel's compensation is based on and capped at 
8.0 hours/day, 5 dqv^rV/eek, irrespective of extended hours; hours or days of approved leave are not 
billed to HART.^acrHeconded personnel has a distinct functional role for the Project and their 
individual rolgjiV^satisfactorily complete their tasks to achieve a cumulative overall objective of 
successfull^NlgSlgning and constructing the HRTP. 

The jiail^^mmary of work performed, therefore, was to add documentation of daily activities to bring 
countability to each individual. There are currently 18 seconded personnel, which means there 
pproximately 1,800 (18 x 5 days (one week) x 20 working days per month) daily entries, submitted 
to HART each month. 
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The contract manager (CM) assigned to manage the PMSC contract each month fastidiousiy checks that 
each seconded personnei has submitted a daiiy entry for each 8.0 hour day biiied. As a part of her 
responsibiiity under HART's Consuitant Invoice Payment Procedure to "review... invoice documentation 
for compiiance with contract terms and conditions," she checks the accuracy of the rates of each 
seconded personnei, checks and caicuiates the reimbursabie Other Direct Costs (ODCs) (such as travei 
costs) for compiiance with the federai Part 31 cost 
principies as required under the Contract, among other 
reviews in accordance with the Invoice Payment 
Procedure. Reiative to the 1,800 summaries of work 
performed, the CM reviews each of the 1,800 entries and 
notes for the PM any questions she has regarding the 
entries. 












ri^ 


Within the first quarter of .7019, 
HART will revise the process for 
reviewing the PMSC invoices. To 
the extent the seccnded 
personnel are a part of the HART 
organizational chart, the 
personnel's direct supervisor, 
whether a consultant or HART, 
;vili be required to review the 
l^ummaries of work performed 
and attest to the work 
performed. 




O 


The First Deputy Executive Director in the first quarter (4 
months) of 2017 reviewed each of the 1,800 entries each 
month and provided feedback, asked for comments and 
inquired after entries with the PMSC. Over time, the 
summaries of work provided by the PMSC seconded 
personnei improved; thereafter, the First Deputy 
Executive Director reiied on the CM's initiai review, 
addressing the questions the CM raised on the entrie: 
and assessed that a detaiied review of the 1,800 e 
wouid be required more on an "audit basis," v, 
from 1-3 months. 

The First Deputy Executive Director agrjH^^ith the State Audit finding regarding insufficient review of 
"third-party project management support consuitants' monthiy invoice justifications on a reguiar basis, 
reiying on the consuitant to det/ifmvre whether its own staffs work is satisfactory," and has taken the 
opportunity of this audit to t^M^niy revise the process to provide a more robust review of the invoice 
justifications, but aiso imp^^ent a meaningfui measurement to evaiuate the performance of the PMSC 
in achieving its overar^ing requirement to successfuiiy compiete the design and construction of the 
Honoiuiu Raii Transl&j^ct. 

As such, the faQ^^ng actions wiii occur in 2019: 

• V(^^h^he first quarter of 2019, HART wiii revise the process for reviewing the PMSC invoices, 
^^trthe extent the seconded personnei are a part of the HART organizationai chart, the 
personnei's direct supervisor, whether a consuitant or HART, wiii be required to review the 
S/y summaries of work performed and attest to the work performed. Rather than have just the 
Project Director approve aii the work summaries and invoice, HART wiii enforce review of the 
work summaries by the direct supervisor. This wiii continue to hoid the consuitant-supervisor 
responsibie for the work of his/her staff. An additionai review wiii be added, however, where a 
reievant HART management staff wiii review the work summaries; for instance, HART Senior 
Adviser (the previous Interim CEO) wiii review the work summaries of the construction 
managers; HART Executive Director-CEO wiii review the work summary of the Project Director; 
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HART Deputy Director of Project Controis, the work summary of the CMS anaiyst. Each PMSC 
seconded personnei work summary wiii be reviewed by a HART management staff. 

• HART wiii impiement a more meaningfui measure to evaiuate the performance of PMSC in 

achieving its responsibiiity to successfuiiy design and buiid the HRTP. At each 6 month interygN^ 
the PMSC wiii be required to provide its status by providing at minimum: (1) Tangibie OtjifOwes 
for each quarter (e.g., compietion of stages of compietion for stations; addressing chang^ 
requests on timeiy basis); (2) Individuai Input (the current daiiy work summaries re^Ti^ to 
meet the Tangibie Objectives); (2) Contract Output (key tangibie deiiverabies 
objectives-e.g., construction of stations meeting 
target compietion; change order documents 
submitted on a timeiy basis); (3) Project 
Outcome (whether the Tangibie Objectives were 
met -e.g., the required percentage compietion 
of station construction to meet the station 
substantiai compietion date). The PMSC 
consuitant wiii be evaiuated on these tangibie 
measurements. The evaiuation wiii be done bi- ^ 
annuaiiy. For 2019, it wiii be particuiariy cruciad 
to gauge the progress of the westside statioj^^' 
construction. ^ 

13. HART does not retain complet^^cumentary evidence of its quaiity management audits of 
consuitants (Page 26) / Is UARS^ssuring quality: We found that they are not (Page 29) 




HART will impltn'ient a more 
meaningfid measure to evaluate 
the performance of PMSC in 
ac>^iov:rig its responsibility to 
s ucce ssfully design and build the 




The FTA and PMOC are 
satisfied with HART's 
Quality Management Plan 
and its implementation. 


I 


There are two different aspects one Quaiity Management 
Pian/System (QMP): Qual^'^^^jitirance (QA) and Quaiity 
Controi (QC). QA focuse^S^the processes that are in piace to 
produce the project dSyerabies at the appiicabie ievei of 
quaiity. It is th^ro^ess of auditing and anaiyzing the 
systems whidw^uce a product in order to improve their 
quaiity. Spw^J^o transit projects, QA is the necessary 
functioi^O insure that each contractor has a quaiified 
m^^^^j^ho is famiiiar with the type of work that the 
oop^^tor is engaged in, and that aii the necessary steps in 

tni^rocess are foiiowed when a product is deiivered. QC is a direct measurement of the project 
deiiverabies for acceptance or rejection. At HART, QC is a function of each department head to ensure 
that ruies, reguiations, criteria, standards, and specifications are foiiowed in the production of their 
work and that a responsibie individuai for each step is signed off by the supervisor. Both are necessary 
in the deiivery of a mega project, but it is important to not confuse them. HART utiiizes both in the 
impiementation of the QMP. The FTA and PMQC are satisfied with HART's Quaiity Management Pian 
and its impiementation. 
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The State Audit scope was iimited to verify compiiance of the HART consuitants for technicai services. 
These inciude HDR, Jacobs, PGH Wong, and Stantec. The scope did not invoive Finai Design, 
Construction, Manufacturing, Testing, Commissioning and Finai Acceptance of the project. 


Audits of Jacobs, PGH Wong, and Stantec 


Jacobs, PGH Wong, and Stantec are traditionai consuitants in the sense that their contracts have a 
specific scope of work, project deiiverabies, and scheduie. They typicaiiy perform the work in thekTS** 
offices and then submit it to HART as a deiiverabie. 

The State audited the 2013-2018 HART Audits of these consuitants. During 2013-2015, w^^s^ to write 
aii our findings and sampied documents/evidence in the Checkiists, inciuding asking tl^^nsuitants 
hard copies of the evidences for audit fiies. From 2016 to present, our current practi^Js to perform 
combined management systems (QA, Buy America, Environmentai Compiiance,a(Q)Safety and Security) 
per ISO 9011. Also in 2016, HART switched to electronic audits during an in-£<^pn meeting. During this 
process, we require the consultants and contractors to project samples c^Jljhjments on the screen for 
the audit team to review per specific audit Checklist to verify complian^to their QA Plan and contract 
requirements. We then require the consultants to give the audit te^i^^n electronic copy of the samples 
as audit evidence. We also use photos from Cell Phones as audiUJ^ords. The consultants receive the 
checklist two weeks prior to the audit meeting for their prej^ararron. We found that this method is more 
productive and efficient for both HART and the consultants\ttd contractors. The audit results and 
reports were based on the evaluation and judgement^^^^fcife HART Certified Quality Auditors (CQA). 

Audit of HDR 








HDR is the Program Management Support Q^hauTtant and follows a different scope of work than 
traditional engineering consultants. HDJR^^fipe not only includes specific deliverables and reporting 
requirements, but also includes the respOTsibility for augmenting HART staff with key personnel. These 
staff are experts in transit systeno'^^ieKexperienced on projects around the world. They are filling 
technical roles that are not av^ij^e in-State. These key personnel are infused into the HART 
organization at different resMtssibilities and capacities. The FTA has approved this method of 
developing the organiz^rtiorVand the key personnel, via the approval of the Project Management Plan 
(PMP) and during rrgpm)^PMQC meetings. In the past two years there have been no changes at the 
HDR's senior staflttei^and HART has been able to restructure the organization to address functions and 
needs of the pw^. HART considers that its organization structure is dynamic as we need to constantly 
focus on diff^^t aspects of the project, as the construction progresses, and therefore take useful and 
necesaiT^^^ps in fine tuning the organization. During the audit process, HART explained to the 
auditor^hat HDR are to be audited based on their assigned responsibilities and scope. Recent steps 
k^g^o regularly meet with HDR's executives and providing them the feedback is reflective in our 




ort that budget and schedule of the project remains unchanged. 

Because HDR staff are a part of the HART organization, the reasonable way to determine their 
"* compliance is by Internal Audit against the PMP and sub-plans and procedures. During the audit process. 




HART provided all internal audit materials from 2012 to present for the auditors to review. 

The focus of this audit was on FY 2017-2018 as per the audit scope. As was explained to the auditors, 
during this period, HART was focused on bringing the PMP and baseline sub-plans and procedures up to 
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date to reflect organizational changes. HART decided that rather than perform audits on compliance 
with obsolete documents, we would focus on the updates and then audit against those. This decision 
was reported to, and supported by, senior management. This issue, and the deficiencies, were reported 
annually to the ED-CEO and senior management by the Director of QA/QC during the annual review 
the adequacy and effective implementation of the Quality Management System (QMP). It shouW 
noted that there are other methods to monitor HDR's work as well, including through review of i^nthly 
invoices, regular check-ins with senior HDR management, and annual performance review^^^ 

QA/QC is a continuously evolving process. HART acknowledges the audit findings r^at^p^ QA/QC and 
in 2019 HART will evaluate the necessary processes to identify areas for improvem^S^ 

The 2012 HART Staffing and Succession Plan referred to is also known as Revi; 0, and has been 
updated several times since 2012. These revisions were based on the City ^Kdlcter change in 2016, the 
Hawaii State Legislative changes in 2017, and multiple internally drivenrfmject reorganizations. 

Revision 6.C is currently being developed by HART staff. Given thexJ>^^j^s to the project, it may not be 
feasible or appropriate to replace consultant positions identified in58l2 with City employees. As 
mentioned in the report, this is a finite that requires relatively.ii^^t-term complement of professionals 
with specialized rail design and construction expertise. 




14. Consultant Audit Checklist (Page 27) 






w 


A QMP must be a holistic program that can^«^ort 
construction, and operations. That saidQjt ail elem 


the project from planning through design, 
elements of the system will be applicable to all 
consultants. Specific to the three coj^i^tants listed in this call-out box (CH2M Hill (now, Jacobs), PGH 
Wong, and Stantec), who are resr^^ihle for supplying technical services to the project, the example 
shown (inspection, measuring, teeing equipment) is not relevant. 


15. Conclusiot; 


t^ 28 ) 




The Audit Reod'S^fers to "gray areas" of governance. 
HART maitiyr^^hat the Charter language which created 
HART io^S^as amended in 2016, provides a framework 
for hi^wjMe Board, Executive Director, and staff interact 
aOTl^^w powers and duties are allocated between them. 

the Charter Amendment 4 in 2016, the Board has the 
discretion, through actions such as Board Resolution No. 
2018-14 to determine what matters need to be brought 
before them in the exercise of their authority, which can 
evolve based upon the changing needs of the project. 

Regarding the statement that the CEQ has the power over 
what issues are presented to the Board - this is not correct. 
The Charter sets forth the matters that require Board 
approval, and beyond that, gives the Board some discretion 


The Audit Report states that 
"...the buck all too often stops 
at a consultant, not with 
HART." In reality, the CEO and 
the Board have ultimate 
ownership of project 
responsibility. If the CEO can't 
manage the project, including 
the consultants, successfully, 
then the Board has the ability 
to replace the CEO. 
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over other matters that it may choose to oversee. The Audit refiects a judgment about issues that 
"shouid be reported to the Board and fuiiy vetted," but that is for the Board and the CEO to determine, 
within the framework created by the Charter. The CEO is uitimateiy heid accountabie to the Board to 
present reievant information though the Board's power to hire and fire him/her. The recent Resoiutions 
have deiegated greater oversight responsibiiities to committees. However, the fact remains that the 
Board hires the CEO and remains reiiant on that person to remain accountabie to the Board. 

The Audit Report states that "...the buck aii too often stops at a consuitant, not with HART." HAR 
acknowiedges and agrees that it hoids the consuitant responsibie for its required performanc9(^«iSer its 
contract. However, the CEO and the Board have uitimate ownership of project responsibm^ iT the CEO 
can't manage the project, inciuding the consuitants, successfuiiy, then the Board has iiity to 






5 ^ 





repiace the CEO. 

HART competes for quaiified empioyees on the open 
market, and the vast majority of HART positions are 
not suitabie for entry-ievei candidates. Consuitant staff 
is phased out at every possibie opportunity when 
HART is abie to find and hire quaiified individuais as 
City empioyees. HART empioyees are usuaiiy expected 
to work at the fuiiy functioning ievei upon start of \ 

empioyment, and they expect to be compensated ^ 

accordingiy. The HART Board of Directors has been 
very proactive in supporting HART's efforts to pay 
reasonabie saiaries, but HART is stiii faced witA^ 
restrictions regarding compensation based^\^e City 
ciassification and pay poiicies and estatm^^ 
compensation scheduies. Pay restri^ions sometimes 
make it impossibie to fiii certaiq^^oStrons with City 
empioyees given the ievei of<«^i^ise required to do 

the job, and the compensa^io^hat ievei of expertise can command in the iabor market. As such, there 
wiii most iikeiy continy^o be a need for a iimited number of empioyees who possess the required skiiis 
or experience wher^SyyKe services wiii continue to be provided on a consuitant contract basis. The 
Project ManagejmBTKlversight Consuitant (PMOC) hired by the FTA to oversee the project has 
acknowiedged reiiance on consuitants in a project of this compiexity is a common practice. 
Neverthee^jHART wiii continue to strive to piace City empioyees in key positions wherever possibie. 

poXors reviewed the Staffing and Succession Pian, Revision 4.0 (2012) during their audit. This 
tnt has been updated severai times in the intervening years, based on the City Charter change in 
, the Hawaii State Legisiative changes in 2017, and muitipie internaiiy driven project 
'eorganizations. In the first quarter of 2019, HART wiii compiete Revision 6.C to the Staffing and 
Succession Pian, after criticai organizationai changes currentiy being considered are decided upon. 




The Project Management 
Oversight Consultant (PMOC) 
hi'r-e-.l by the FTA to oversee the 
^ project has acknowledged that 
reliance on consultants in a 
project of this complexity is a 
common practice. Nevertheless, 
HART will continue to strive to 
place City employees in key 
positions wherever possible. 
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